JP2009296503A - Image processing system, image processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To generate recording data by an arithmetic unit, without impairing the execution of other processing by the arithmetic unit. <P>SOLUTION: A digital still camera is provided with an image generating unit 102 and an audio generating unit 103, which perform data processing on material data 90, on the basis of scenario data 93; an A/V codec unit 104 which generates the recording data 94, by encoding editing data (image stream information and audio stream information) generated by the image generating unit 102 and audio generation unit 103, and a schedule unit 105, which detects the free time of a CPU (arithmetic unit) of the digital camera. Then only when the schedule unit 105 detects the free time, will the A/V codec unit 104 start the encoding (generation processing for the recording data 94). <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technique for processing encoded material data by processing material data including image data acquired by a user.

  Recently, mobile phones with cameras and digital still cameras have become widespread, and general users can easily enjoy digital image data. These image data are not only displayed as still images on the display for enjoyment, but they can also be displayed as image data with various special effects, including narration by synthesizing with audio data and text data. The form has diversified.

  2. Description of the Related Art Conventionally, a technique for creating editing data (video stream) for displaying a plurality of still image data captured by a digital still camera at a certain time interval in the order of shooting and displaying a moving image such as a slide show is known. Yes.

  On the other hand, usage forms of moving images are diversifying, such as creating a blog with moving images, uploading to a video posting site, or writing to a DVD. That is, there is a strong demand not only for viewing the edited data on the spot where it was created, but also for creating the recording data for storage (for example, a Motion JPEG file or an MPEG file) by encoding the edited data. .

JP 2007-306426 A JP 2008-042256 A

  However, when editing data relating to a moving image is created and recording data is created by encoding the editing data, there is a problem that the amount of calculation in image processing and the time required for the image processing increase. In this case, there is a problem that the arithmetic device that performs the image processing is occupied for creating the recording data, and during that time, other processing by the arithmetic device cannot be executed.

  The present invention has been made in view of the above problems, and an object of the present invention is to create recording data by the arithmetic device without interfering with execution of other processing by the arithmetic device.

  In order to solve the above-mentioned problems, the invention of claim 1 is an image processing system for creating recording data encoded based on material data, which is applied to requested material data and the requested material data. Storage means for storing scenario data indicating a correspondence relationship with data processing and material data required in the scenario data in advance, and requested in the scenario data based on the scenario data stored in the storage means Generating means for generating edit data by applying the specified data processing to the material data, and encoding the edit data generated by the generating means by calculation A computing means for generating recording data; and an idle time during which the computing means is not executing a task, Wherein such coding is performed in the idle time due to, characterized in that it comprises a scheduling means for determining when said calculation means starts the encoding.

  The invention according to claim 2 is the image processing system according to the invention according to claim 1, wherein the scheduling means determines the timing for starting generation of edit data by the generating means, whereby the calculating means The timing for starting the encoding is determined.

  According to a third aspect of the present invention, there is provided the image processing system according to the first or second aspect of the present invention, wherein the schedule means detects the idle time in response to a user operation.

  According to a fourth aspect of the present invention, there is provided the image processing system according to any one of the first to third aspects, wherein the scheduling means monitors whether or not the calculation means is executing a task. The free time is detected.

  Further, the invention of claim 5 is the image processing system according to the invention of claim 4, wherein the scheduling means detects that the computing means has not executed a task for a predetermined time, It is determined that the idle time is detected.

  The invention of claim 6 is an image processing method for creating recording data encoded based on material data, wherein (a) requested material data and data processing applied to the requested material data; Storing the scenario data indicating the correspondence relationship of the above and the material data required in the scenario data in the storage means in advance, (b) detecting the idle time when the calculation means is not executing the task, c) Based on the scenario data stored in the storage means, the data processing to be applied to the material data required in the scenario data is specified, and the specified data processing is applied to the material data to edit data. And (d) is transmitted to the calculation means in the step (c) in response to the detection of an idle time in the step (b). Characterized by a step of generating print data is encoded by calculating the edit data to the arithmetic unit.

  The invention of claim 7 is the image processing method according to the invention of claim 6, wherein the step (c) is started in response to the detection of an empty time in the step (b). It is characterized by being.

  The invention according to claim 8 is a program executed by a computer comprising storage means and calculation means, and the execution of the program by the computer is: (a) requesting material data and the request Storing scenario data indicating a correspondence relationship with data processing to be performed on the material data to be performed and material data required in the scenario data in the storage unit in advance, and (b) the calculation unit executes the task A step of detecting a free time that has not been performed, and (c) identifying data processing to be performed on material data required in the scenario data based on the scenario data stored in the storage means Performing the processed data on the material data to generate edit data and transmitting it to the computing means; and (d) the step (b). In response to the detection of a free time, the editing data transmitted to the calculation means in the step (c) is encoded by causing the calculation means to calculate and generating recording data. It is characterized by.

  The invention of claim 9 is a program according to the invention of claim 8, wherein the computer is caused to start the step (c) in response to the detection of an empty time in the step (b). Features.

  The invention according to any one of claims 1 to 9 detects the idle time when the computing means is not executing a task, and the computing means starts encoding so that the encoding by the computing means is performed during the detected idle time. By determining the timing to perform recording, it is possible to create recording data by the computing means without hindering the execution of other tasks by the computing means.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described in detail with reference to the accompanying drawings.

<1. First Embodiment>
FIG. 1 is a diagram illustrating an information processing system 1 according to the first embodiment. The information processing system 1 includes a digital still camera 2 configured as an image processing system according to the present invention, a terminal device 3, and a server device 7 installed in, for example, a content provider. In the information processing system 1 according to the present embodiment, the terminal device 3 and the server device 7 are connected to each other via a network 8.

  The network 8 corresponds to the Internet or a public network. Further, the number of server devices 7 is not limited to one. For example, a plurality of server devices 7 may be connected to the network 8.

  The server device 7 is configured as a general computer including a database 70 and is connected to the network 8 as described above. In the database 70 of the server device 7, scenario source data 72, GUI data 73, and material data 74 (hereinafter may be collectively referred to as “content data 71”) are stored in advance. Note that the content data 71 need not include all of the scenario source data 72, the GUI data 73, and the material data 74, and may be any of them.

  The content data 71 is data created in advance by an operator (such as an illustrator, a cameraman, or a programmer) who has specialized knowledge about image processing. Therefore, the content data 71 is provided as data having higher quality than data created by a general user. The scenario source data 72 and the GUI data 73 in the content data 71 are data executed in the digital still camera 2 and are text data described in a script language or the like, for example.

  The scenario source data 72 is created for each of various themes such as weddings, golf competitions, athletic events, and graduation ceremonies, and is stored in association with the corresponding themes. Accordingly, the user simply selects a specific theme, and the content provider provides the scenario source data 72 for creating the desired edit data without having to understand the details of the individual scenario source data 72 in detail. It is possible to easily specify from a plurality of scenario source data 72 to be executed.

  The themes associated with the scenario source data 72 are not limited to those listed above, but are preferably those that the user can easily come up with according to the situation and easily imagine the contents. The edit data is data necessary for creating video and audio to be viewed by the user. In this embodiment, the edit data is uncompressed stream information representing an image (still image or moving image) or audio. is there.

  Each theme is also associated with corresponding GUI data 73. That is, the scenario source data 72 and the GUI data 73 are associated with each other via the theme. The associated GUI data 73 may be dedicated GUI data 73 for each scenario source data 72, or may be general-purpose GUI data 73 commonly used in a plurality of scenario source data 72. Since the GUI data 73 is associated with the scenario source data 72 in this way, the user can specify the scenario source data 72 only by selecting a theme and also specify the GUI data 73 necessary for the scenario source data 72. it can.

  In the scenario original data 72, identifiers of pre-edit data (image data, audio data, font data, etc.) necessary for the target edit data are described, and decorations (data processing) to be executed for each pre-edit data. ) Is described for each pre-edit data. That is, in the scenario original data 72, the identifier of the pre-edit data and the data processing are described in association with each other.

  As the data processing described in the scenario original data 72, for example, what kind of image effect (Effect) is applied to the pre-edit data representing the image, what kind of image synthesis (Synthesis) is performed, or how It is assumed that the image transition (Transition) is performed. In addition, setting data (information indicating the type of data processing) related to reproduction timing, volume, and the like is described for pre-edit data that represents audio.

  Further, data processing such as converting voice data into an image and synthesizing it into image data, or conversely, recognizing an image (character) and converting it into voice data (read-out voice) is also assumed. The data processing is selected by an operator who is an image processing expert according to the corresponding pre-edit data and is described in the scenario source data 72.

  Of the pre-edit data whose identifier is described in the scenario source data 72, the data produced by the operator (the material data 74 existing in the server device 7) is associated with the material data 74 in the scenario source data 72. Has already been. Therefore, when the scenario source data 72 is specified, the material data 74 used in the specified scenario source data 72 is also specified as pre-edit data.

  As described above, the content provider associates each of the scenario source data 72, the GUI data 73, and the material data 74 on the server device 7 so that the necessary scenario source data 72, material data 74 can be easily specified only by the user selecting a theme. To provide.

  The GUI data 73 provides an appropriate GUI to the user of the digital still camera 2 in accordance with the corresponding scenario source data 72. That is, by executing the GUI data 73, the digital still camera 2 inputs the specific information for specifying the pre-edit data required in the scenario original data 72 from the material data 90 (FIG. 2). A request is made to the user, and the user operation in the digital still camera 2 is supported.

  For example, among the pre-edit data requested by the corresponding scenario source data 72, the data that the user must specify (select) is prompted to input, or appropriate material data 90 is used as the pre-edit data. Information related to the pre-edit data is displayed so that the user can easily specify it.

  The material data 74 is data to be processed in the digital still camera 2, and is image data, audio data, font data, or the like. The image data included in the material data 74 is, for example, an animated character or a famous scene of a movie, a landscape image of a famous place, an illustration image, and the like, and may be a moving image instead of a still image. The voice data includes, for example, voice actors and actors' voices, BGM, animal calls, musical instrument sounds, sound effects, etc., and may be actually recorded data or mechanically synthesized. Data for outputting sound may be used. The material data 74 is data produced and collected by an expert operator as the optimum data for each scenario source data 72.

  Although not shown in detail, the terminal device 3 is a device having a configuration and functions as a general computer, and is connected to the network 8. In other words, in the information processing system 1, data communication via the network 8 is possible between the terminal device 3 and the server device 7. Therefore, the user can download the content data 71 from the server device 7 to the terminal device 3 by operating the terminal device 3.

  Further, the terminal device 3 can be detachably connected to the digital still camera 2 via the cable 30. That is, the user digitally connects the digital still camera 2 and the terminal device 3 with the cable 30 and transfers the content data 71 downloaded from the server device 7 to the terminal device 3 to the digital still camera 2. The content data 71 can be stored in the still camera 2.

  The digital still camera 2 is designed so that a portable recording medium 9 can be freely attached and detached as shown in FIG. Therefore, the digital still camera 2 reads and uses data stored in the attached recording medium 9 or uses data generated by the digital still camera 2 (or data transferred from the terminal device 3). 9 can be stored. In the present embodiment, an SD card is adopted as the recording medium 9, but the recording medium 9 is not limited to this, and may be, for example, a PC card or a memory stick.

  FIG. 2 is a block diagram showing a configuration of the digital still camera 2 configured as an image processing system in the first embodiment. In the example shown in FIG. 2, scenario original data 72, GUI data 73 and material data 74 downloaded from the server device 7 are already stored in the recording medium 9 of the digital still camera 2.

  The imaging data 91 and the recording data 92 are data derived from the user (meaning that the data is not provided from the server device 7) that is captured or recorded by the user in the digital still camera 2. Therefore, the material data 90 stored in the recording medium 9 includes imaging data 91 and recording data 92 in addition to the material data 74 produced by the operator, as shown in FIG.

  As described above, since the material data 74 is data that is specified and downloaded by selecting a theme, it is pre-edit data requested in the scenario source data 72 associated with the theme. That is, in the present embodiment, the material data 90 includes data other than pre-edit data.

  The digital still camera 2 includes a CPU 20 that performs arithmetic processing on various data and a storage unit 21 that appropriately stores various data as necessary, and is also configured as a general computer.

  The CPU 20 controls each component of the digital still camera 2 by operating according to the program 210 stored in the ROM of the storage unit 21 while using the RAM of the storage unit 21 as a temporary working area. The CPU 20 also has a function of executing the scenario original data 72 and the GUI data 73 downloaded from the server device 7 and stored in the recording medium 9, but details will be described later.

  The digital still camera 2 has a configuration for capturing various data, an operation unit 22 operated by a user, a microphone 23 for recording by converting surrounding sound into an electric signal, and incident light as an electric And an imaging unit 24 that performs imaging by converting the signals into signals.

  The operation unit 22 is used for a user to input an instruction to the digital still camera 2. The operation unit 22 includes, for example, a shutter button for inputting an instruction for causing the digital still camera 2 (imaging unit 24) to perform imaging, buttons for inputting setting data necessary for the operation of the digital still camera 2, Or it is comprised by the key etc. for inputting character data. In particular, in the present embodiment, the operation unit 22 specifies the pre-edit data from the material data 90 stored in the recording medium 9 when the user selects a desired theme (scenario source data 72). It is operated when inputting specific information.

  As described above, the microphone 23 has a function of converting sound into an electric signal. The electric signal acquired by the microphone 23 is A / D converted and then converted into sound data to a data conversion unit 27 described later. Communicated.

  The imaging unit 24 includes an optical system such as a lens and a plurality of photoelectric conversion elements (for example, CCD elements) that receive light guided by the optical system and convert it into an electrical signal. The plurality of photoelectric conversion elements are arranged in an array, and each outputs an electrical signal corresponding to the amount of light received during imaging.

  The imaging unit 24 performs imaging when the user operates the operation unit 22 (shutter button). Each output signal obtained from a plurality of photoelectric conversion elements by one imaging is subjected to A / D conversion, color correction, and the like, and then converted into digital data representing one image as a data conversion unit to be described later 27.

  As a configuration for outputting various data, the digital still camera 2 includes a speaker 25 that reproduces sound by an electric signal generated based on the sound data, and a liquid crystal panel 26 that displays an image based on the image data. .

  The speaker 25 is a device for playing back sound based on the recording data 92, the sound stream information included in the editing data, or the sound data constituting the playback data (described later).

  The liquid crystal panel 26 is configured as a display device that displays necessary data as an image under the control of the CPU 20. For example, the liquid crystal panel 26 not only reproduces and displays material data 90 (data representing an image) stored in the recording medium 9 and data related to video in the created editing data, but also gives instructions from the CPU 20. And has a function of displaying a predetermined message (character) or the like.

  In particular, the liquid crystal panel 26 according to the present embodiment has a function of displaying a GUI screen provided when the CPU 20 executes the GUI data 73, image stream information included in edit data, image data constituting playback data, or the like. have.

  Further, the digital still camera 2 includes a data conversion unit 27, a card slot 28, and a communication unit 29.

  The data converter 27 is mainly composed of a logic circuit (hardware), and has a function of compressing (encoding) the data format of transmitted data and a function of decoding the compressed and converted data. .

  The data conversion unit 27 according to the present embodiment has a function of generating image data transmitted from the imaging unit 24 as imaging data 91 (still image data) compressed in JPEG format, and JPEG-format image data (imaging data 91). And a function of converting the information into a state that can be displayed on the liquid crystal panel 26.

  The data conversion unit 27 also decodes the MP3 format audio data (including the recording data 92) by decoding the audio data transmitted from the microphone 23 as the recording data 92 compressed into the MP3 format, and the speaker 25. Has a function of converting to a reproducible state.

  In general, image data obtained by imaging and audio data obtained by recording are data having a large data size. Therefore, if this is stored (stored) as it is without being compressed, the data capacity (data amount that can be stored) of the recording medium (recording medium 9) may be insufficient. Therefore, in a device having an imaging function and a recording function, it is widely adopted as a general architecture to provide dedicated hardware such as a data conversion unit 27 that compresses data obtained by imaging or recording for storage. ing. However, the format for compressing and converting image data and audio data is not limited to the JPEG format or the MP3 format. The imaging data 91 and the recording data 92 generated by the data conversion unit 27 are transferred to the recording medium 9 and stored.

  The card slot 28 is a hardware interface that provides a function of attaching the recording medium 9 to the digital still camera 2. By mounting the recording medium 9 in the card slot 28, the digital still camera 2 can use the recording medium 9 as a storage device.

  The communication unit 29 has a function of detachably connecting the digital still camera 2 to the terminal device 3 via the cable 30. Thereby, the digital still camera 2 can acquire the content data 71 from the terminal device 3. In the information processing system 1 according to the present embodiment, a USB cable and a USB terminal are employed as the cable 30 and the communication unit 29.

  The configuration for the digital still camera 2 to acquire the content data 71 from the terminal device 3 is not limited to data communication via the cable 30. For example, the recording medium 9 may be attached to the terminal device 3, the content data 71 may be stored in the recording medium 9 in the terminal device 3, and then the recording medium 9 may be attached to the digital still camera 2. When configured in this manner, the communication unit 29 is not necessary in the digital still camera 2.

  As described above, each hardware of the digital still camera 2 in the present embodiment does not have to be dedicated hardware specialized for the present invention, and is widely distributed in general. The same hardware as the device can be employed. Therefore, a commercially available imaging device can be adopted as hardware for realizing the present invention, and the cost of the entire system can be suppressed.

  FIG. 3 is a diagram showing functional blocks of the digital still camera 2 configured as an image processing system in the first embodiment together with a data flow. The request unit 100, scenario analysis unit 101, image generation unit 102, audio generation unit 103, A / V codec unit 104, and schedule unit 105 shown in FIG. 3 are mainly according to a program 210 stored in the storage unit 21 by the CPU 20. It is a functional block realized by operating.

  In the following description, it is assumed that “theme” has already been selected by the user, and one scenario source data 72 specified according to the selected theme has been acquired in the digital still camera 2. That is, in FIG. 3, when the user operates the operation unit 22, the specification of the scenario source data 72 has already been completed, and the GUI data 73 and the material data 74 associated with the specified scenario source data 72 have already been recorded. The state stored in the medium 9 is shown.

  The request unit 100 refers to the GUI data 73 and provides a GUI that prompts the user of the digital still camera 2 to input necessary information according to the contents described therein. That is, the request unit 100 displays a menu screen, an input screen, or the like on the liquid crystal panel 26, thereby prompting the user to input specific information for specifying pre-edit data required in the scenario source data 72. It has the required function.

  The identifier of the pre-edit data described in the scenario original data 72 is, so to speak, a role name in the edit data. Which actor (material data 90) is specifically assigned to each role name is determined by the user inputting specific information. When the user inputs according to the GUI provided by the GUI data 73, the identifier (title) of the pre-edit data and the identifier (actor name) of the material data 90 are associated with each other.

  In other words, the user simply inputs the information requested by the GUI screen displayed on the liquid crystal panel 26 by operating the operation unit 22 in accordance with the GUI screen. It is possible to give the digital still camera 2 instructions necessary for creating edit data.

  In addition, the request unit 100 according to the present embodiment not only requests to select data to be pre-edit data from the material data 90 already stored in the recording medium 9, but also uses the material collection instruction information as a GUI screen. By displaying on the liquid crystal panel 26, the user is requested to acquire new material data 90 as pre-edit data. Specifically, it requests not only to select past imaging data 91 that has already been captured and collected, but also to acquire imaging data 91 by performing a new imaging.

  That is, for example, the request unit 100 requests the user to perform image capturing by the image capturing unit 24 by displaying image capturing instruction information on the liquid crystal panel 26, and also captures image data 91 generated by image capturing performed in response to the request. Is generated as the pre-edit data required in the scenario source data 72. The imaging instruction information can include not only a message for instructing to perform new imaging, but also a message for instructing what kind of scene or subject should be imaged.

  Note that the request unit 100 also has a function of storing data newly acquired by image capturing (or recording) by the user in the recording medium 9 via the data conversion unit 27 in accordance with the GUI screen. That is, new data (audio data and image data) input from the microphone 23 and the imaging unit 24 to the request unit 100 is compressed by the data conversion unit 27, transferred to the recording medium 9, and stored as material data 90. Is done.

  Each material data 90 selected or newly acquired in accordance with an instruction from the user is regarded as specified by the user as each pre-edit data declared in the scenario source data 72, and is associated with each other. Information is transmitted from the request unit 100 to the scenario analysis unit 101. That is, at the stage where the user designation for all the pre-edit data has been completed, the request unit 100 stores the identifier of the pre-edit data requested in the scenario source data 72 and each material data 90 stored in the recording medium 9. Information (hereinafter referred to as “material designation information”) associated with an identifier on the recording medium 9 (for example, the file name of each material data 90 in the recording medium 9) is transmitted to the scenario analysis unit 101. In the example shown above, the material designation information is list information in which a role name and an actor name are associated with each other.

  Based on the material designation information and the scenario source data 72 transmitted from the request unit 100, the scenario analysis unit 101 performs pre-editing requested in the scenario source data 72 from the material data 90 stored in the recording medium 9. Identify the data.

  In addition, the scenario analysis unit 101 associates the identifier of the material data 90 identified as the pre-edit data and the identifier indicating the data processing to be executed on the pre-edit data with the pre-edit data identifiers associated with each other. Are associated with each other, scenario data 93 is created and stored in the recording medium 9. That is, the scenario data 93 is data created by the scenario analysis unit 101 based on the scenario original data 72 and the material designation information, and includes requested material data 90 and data processing applied to the material data. It is the data which shows the corresponding relationship.

  By creating such scenario data 93, all material data 90 required for creating edit data is specified, and data processing for each material data 90 is specified. In the digital still camera 2, scenario data 93 is created in various scenes. That is, the scenario data 93 stored in the recording medium 9 is not limited to one, and a plurality of scenario data 93 may exist. In the following description, among the plurality of scenario data 93, the scenario data 93 corresponding to the edit data to be created is particularly referred to as “target scenario data 93”.

  The image generation unit 102 refers to the target scenario data 93 (more specifically, the target scenario data 93 related to the video), and based on the identifier of the material data 90 described therein, the corresponding material data 90 from the recording medium 9. Is read. Then, according to the data processing identifier associated with the material data 90 in the target scenario data 93, the material data 90 is subjected to data processing to be edited data (more specifically, data related to the video in the editing data). ) Is generated. Note that the image generation unit 102 analyzes the image in the material data 90 to determine the movement and shape of the subject when performing data processing on the material data 90, and performs various processes such as image composition, interpolation, and conversion. It also has a function to perform.

  The image generation unit 102 transmits editing data related to the generated video to the liquid crystal panel 26 or the A / V codec unit 104. The image generation unit 102 according to the present embodiment transmits the generated edit data to the A / V codec unit 104 only when the schedule unit 105 instructs the creation of the edit data. On the other hand, when the user gives an instruction to create and play the edited data while calculating in real time, the image generating unit 102 does not transmit the generated edited data to the A / V codec unit 104, but the liquid crystal panel 26. To communicate. As a result, an image (mainly a moving image) related to the editing data is displayed on the liquid crystal panel 26.

  The sound generation unit 103 refers to the target scenario data 93 (more specifically, the target scenario data 93 related to sound), and based on the identifier of the material data 90 described therein, the corresponding material data 90 from the recording medium 9. Is read. Then, according to the data processing identifier associated with the material data 90 in the target scenario data 93, the material data 90 is subjected to data processing to be edited data (more specifically, data related to the voice of the editing data). ) Is generated.

  The audio generation unit 103 transmits editing data related to the generated audio to the speaker 25 or the A / V codec unit 104. The sound generation unit 103 in the present embodiment transmits the generated edit data to the A / V codec unit 104 only when the schedule unit 105 instructs the creation of the edit data. On the other hand, when the user gives an instruction to create and play the edited data while calculating in real time, the voice generating unit 103 does not transmit the generated edited data to the A / V codec unit 104 and sends it to the speaker 25. introduce. Thereby, the sound related to the editing data is reproduced by the speaker 25.

  The A / V codec unit 104 encodes editing data (image stream information and audio stream information) generated and transmitted by the image generation unit 102 and the audio generation unit 103 to generate recording data 94 and stores it in the recording medium 9. It has a function to make it. The A / V codec unit 104 is a functional block realized when the CPU 20 performs an operation according to the program 210 as described above. Therefore, the CPU 20 mainly corresponds to the calculation means in the present invention.

  The A / V codec unit 104 in the present embodiment creates recording data 94 as data compressed in the “Motion JPEG format”. “Motion JPEG format” is an encoding method (standard) in which image data of each frame constituting a moving image is in JPEG format.

  In general, the image stream information generated by the image generation unit 102 and the audio stream information generated by the audio generation unit 103 are data having a large data size. Therefore, if this is stored (stored) as it is without being compressed, the data capacity (data amount that can be stored) of the recording medium (recording medium 9) may be insufficient.

  However, the digital still camera 2 in the present embodiment can suppress the size of the data for storage by creating the recording data 94 compressed in the “Motion JPEG format”.

  In addition, by generating the recording data 94 that is data-compressed in accordance with a widely used standard, for example, the recording data 94 can be easily reproduced on other devices, and the versatility of the recording data 94 for storage can be reduced. Will improve. However, the data format of the recording data 94 is not limited to the “Motion JPEG format”, and may be, for example, an MPEG format in which the compression rate is further improved based on the difference in image data between frames.

  When the user gives an instruction to reproduce the recorded data 94, the A / V codec unit 104 decodes the recorded data 94 stored in the recording medium 9, and the reproduced data relating to the image is displayed on the liquid crystal panel 26. In addition to displaying, the speaker 25 has a function of reproducing reproduction data related to sound.

  In the present embodiment, when the scenario data 93 is created by the scenario analysis unit 101, the schedule unit 105 stores the identifier of the newly created scenario data 93 in the management data 95, and manages the scenario data 93 Register in the data 95. On the other hand, the schedule unit 105 deletes the identifier of the scenario data 93 corresponding to the created recording data 94 from the management data 95 when the recording data 94 is created by the A / V codec unit 104.

  Further, the schedule unit 105 has a function of monitoring whether or not the scenario data 93 for which the recording data 94 should be created exists in the recording medium 9 based on whether or not the scenario data 93 is registered in the management data 95. is doing. If the scenario data 93 registered in the management data 95 exists, the CPU 20 (A / V codec unit 104) detects the free time during which the CPU 20 is not executing a task and encodes it (record data). The timing at which the A / V codec unit 104 creates the recording data 94 is determined so that the creation of the recording data 94 is performed during the idle time.

  As described above, when generation of edit data is instructed by the schedule unit 105, the image generation unit 102 and the sound generation unit 103 transmit the edit data to the A / V codec unit 104 and record it by the A / V codec unit 104. Data 94 is generated. That is, the schedule unit 105 in the present embodiment determines the timing for starting the generation of edit data by the image generation unit 102 and the audio generation unit 103, so that the A / V codec unit 104 creates the recording data 94. Determine timing. Note that a method by which the schedule unit 105 determines the timing will be described later.

  Further, the schedule unit 105 instructs the image generation unit 102 and the sound generation unit 103 to start generation of edit data at the determined timing, and determines which scenario data 93 is used to generate the edit data. And instructs the voice generation unit 103. Specifically, the identifier of the scenario data 93 acquired from the management data 95 (that is, the identifier of the target scenario data 93) is transmitted to the image generation unit 102 and the sound generation unit 103 at the determined timing.

  The above is the description of the configuration and functions of the information processing system 1. Next, an image processing method performed by the digital still camera 2 will be described.

  FIG. 4 is a flowchart showing the image processing method according to the first embodiment. It is assumed that the digital still camera 2 is in the monitoring state after the power is turned on by the user and predetermined initial settings are made before the processing shown in FIG. 4 is started.

  In the monitoring state, the CPU 20 of the digital still camera 2 determines whether a scenario has been instructed by the user (step S1), whether the scenario data 93 is registered in the management data 95 (step S3), and terminates the processing in the digital still camera 2. It is monitored whether an instruction to perform has been given by the user (step S6).

  The scenario creation instruction is an instruction for causing the digital still camera 2 to create new scenario data 93, which is input when the user operates the operation unit 22 and is detected by the CPU 20. Whether or not the scenario data 93 is registered in the management data 95 is detected by the CPU 20 when the schedule unit 105 refers to the management data 95. Further, the instruction to end the processing by the digital still camera 2 is that the power of the digital still camera 2 is turned off when the user operates the operation unit 22.

  Note that the processing executed by the CPU 20 in the monitoring state is not limited to the monitoring processing (steps S1, S3, and S6) shown in FIG. 4, and other processing (tasks) such as normal imaging processing as appropriate. Monitoring processing for accepting is also executed. Therefore, while the steps S1, S3, and S6 are executed, another task accepted by another monitoring process is executed by the CPU 20 as appropriate.

  In the monitoring state, when the user operates the operation unit 22 to give a scenario creation instruction, the CPU 20 determines Yes in step S1, and executes scenario data creation processing (step S2). In other words, the scenario data creation process is selected as a task to be executed by the CPU 20, and the process is started.

  FIG. 5 is a flowchart showing scenario data creation processing in the first embodiment. It is assumed that content data 71 created by the operator is stored in the server device 7 before the scenario data creation processing is started. That is, it is assumed that the process of creating the scenario source data 72 in advance by the operator who is an image processing expert has already been completed before each process shown in FIG.

  First, the user connects the digital still camera 2 and the terminal device 3 with the cable 30. Next, a theme is input according to a desired situation by operating the operation unit of the terminal device 3. For example, when editing the material data 90 obtained by imaging a wedding to create edited data, the user inputs “wedding” as the theme. More specifically, the user also inputs an address in the network 8 of the server device 7 and information specifying the recording medium 9 of the digital still camera 2 as a storage location of the content data 71 to be downloaded.

  In response to this, the terminal device 3 accesses the server device 7 via the network 8 and transmits the input theme “wedding” to the server device 7. The server device 7 searches the database 70 using the theme “wedding” transmitted from the terminal device 3 as a keyword, and the scenario source data 72 associated with the theme is stored in the terminal device 3 together with the GUI data 73 and the material data 74. Send. As a result, the content data 71 (scenario source data 72, GUI data 73, and material data 74) is downloaded to the terminal device 3 (step S11) and stored in the recording medium 9 attached to the digital still camera 2. .

  When the download is completed, the user disconnects the cable 30 from the digital still camera 2 and releases the connection state between the digital still camera 2 and the terminal device 3. As a result, the digital still camera 2 becomes portable again and is brought to an arbitrary location (imaging location) by the user.

  Next, the user operates the operation unit 22 to instruct the start of designated work (step S12). In response to this instruction, the request unit 100 of the digital still camera 2 refers to the GUI data 73 stored in the recording medium 9, and displays a GUI screen that prompts the user for necessary input on the liquid crystal panel 26 (step S13).

  At this time, the request unit 100 displays data related to the requested pre-edit data, and selects whether or not to select from the material data 90 already stored in the recording medium 9 as the pre-edit data. A message requested to the user is displayed (step S14).

  When designating the material data 90 already stored in the recording medium 9, the user inputs “select” in step S14. Accordingly, the request unit 100 determines Yes in step S14, and displays a selection screen displaying a list of material data 90 stored in the recording medium 9 at that time as a GUI screen on the liquid crystal panel 26 (step S15). When the selection screen is displayed, the user selects the material data 90 as pre-edit data by inputting specific information for specifying appropriate data from the displayed material data 90 (step S16). .

  As a result, one pre-edit data required in the scenario source data 72 is specified from the material data 90, and one record of material designation information is created. The case where step S16 is executed indicates that one of the requested pre-edit data has already been stored as the material data 90 on the recording medium 9.

  On the other hand, when the user desires to newly acquire the material data 90, “not selected” is input in step S14. Accordingly, the request unit 100 determines No in step S14, and displays the acquisition screen on the liquid crystal panel 26 as a GUI screen (step S17). When the acquisition screen is displayed, the user operates the operation unit 22 to perform imaging (or recording) according to the imaging instruction information (or recording instruction information) displayed on the acquisition screen, thereby imaging (or recording). Is performed (step S18).

  The image data or audio data acquired by executing step S18 is subjected to predetermined data compression by the data converter 27 and then stored in the recording medium 9 as material data 90 (imaging data 91 or recording data 92). Is done. Further, the request unit 100 identifies the material data 90 created in step S18 as one of the pre-edit data requested in the scenario source data 72, and creates one record of material designation information.

  That is, by executing step S18, among the material data 90 required for creating one piece of edit data, material data 90 that has not yet been stored in the recording medium 9 (has not been created). One is newly created and stored. Note that step S18 is not limited to the process in which only one of imaging and recording is performed, and imaging and recording may be performed at the same time. That is, the imaging data 91 and the recording data 92 may be created by one designation.

  Each time step S16 or step S18 is executed, the request unit 100 refers to the GUI data 73 to determine whether or not all pre-edit data has been specified (step S19). If there is pre-edit data that has not yet been specified among the pre-edit data requested in the referenced GUI data 73 (that is, the pre-edit data requested in the scenario source data 72), the request unit 100 performs a step. It determines with No in S19 and repeats the process from step S13.

  On the other hand, if all the pre-edit data has been specified, the request unit 100 determines Yes in step S19. As a result, all the material data 90 required in one editing data is stored in the recording medium 9 and specified.

  When all the data before editing is specified (Yes in step S19), the scenario analysis unit 101 refers to the material designation information transmitted from the request unit 100 and the scenario original data 72 stored in the recording medium 9. To do. Then, each material data 90 specified as pre-edit data is associated with data processing to be executed for each material data 90, and scenario data 93 is generated and stored in the recording medium 9 (step S20).

  In step S20, the schedule unit 105 registers the identifier of the scenario data 93 generated in step S20 in the management data 95. In the present embodiment, when the scenario data 93 is created, the identifier of the scenario data 93 is automatically written and registered in the management data 95. As a result, the user can reserve the creation processing of the recording data 94 by the scenario data 93 only by instructing the creation of the scenario data 93. However, registration (or deletion) in the management data 95 may be performed by a separate instruction from the user.

  As described above, the digital still camera 2 creates scenario data 93 for creating editing data and material data 90 not included in the content data 71 among the material data 90 required in the scenario data 93. Can be stored (or specified from already stored material data 90). The material data 74 can be stored in advance by downloading.

  It is also possible to store a plurality of scenario data 93 and material data 90 required in each by repeating the scenario data creation process a plurality of times.

  When the process of step S20 ends, the digital still camera 2 ends the scenario creation process shown in FIG. 5, returns to the process of FIG. 4, and enters the monitoring state again.

  In the monitoring state, when the schedule unit 105 detects that the identifier of the scenario data 93 is registered in the management data 95 by referring to the management data 95, the schedule unit 105 sets the scenario data for creating the recording data 94. 93 is determined to exist, and Yes is determined in step S3.

  When it determines with Yes in step S3, the schedule part 105 further determines whether it is the idle time when CPU20 is not performing the task (step S4).

  In step S4, the CPU 20 of the digital still camera 2 can consider several methods for detecting free time.

  For example, when executing step S4, it may be determined whether or not the CPU 20 is executing a task. If the task is not being executed, it may be determined that a free time has been detected. That is, it is possible to adopt a method of determining whether or not the task is being executed at each timing of executing step S4 and determining whether or not the idle time is detected according to the determination result. Alternatively, when the CPU 20 detects that a task is not executed for a predetermined time (preliminarily initialized time), it may be determined that a free time has been detected.

  Furthermore, it is possible to detect the idle time by using a user operation as a trigger.

  The user operation that can be determined that the idle time has been detected is, for example, an operation in which the user gives an instruction to shift the digital still camera 2 to the sleep mode. Alternatively, the user may perform an operation of attaching the cable 30 to the digital still camera 2 and connecting the digital still camera 2 to the terminal device 3. This is because when the portable digital still camera 2 is connected to the terminal device 3, it is rare that the user requests an imaging process (other tasks to be prioritized) in that state. In addition, when the USB connection is adopted as in the present embodiment, it is possible to supply power for creating the recording data 94 from the terminal device 3, which is more convenient.

  When it is determined by these methods that the CPU 20 has detected a free time during which no task is being executed, the scheduling unit 105 determines Yes in step S <b> 4, and determines the timing at which the determination is made as the A / V codec unit 104. The CPU 20 determines the timing for starting the process of creating the recording data 94.

  In other words, the schedule unit 105 transmits the identifier of the scenario data 93 to the image generation unit 102 and the sound generation unit 103 at the timing determined as Yes in step S4, whereby the digital still camera 2 starts the recording data generation process. (Step S5).

  FIG. 6 is a flowchart showing the recording data generation process. The recording data creation process is started only when the scenario data 93 is registered in the management data 95. Therefore, before the recording data generation process shown in FIG. 6 is started, the scenario data creation process shown in FIG. 5 is executed at least once in the digital still camera 2, and the recording medium attached to the digital still camera 2 is installed. 9, at least one scenario data 93 and all material data 90 required in the at least one scenario data 93 are already stored.

  When the recording data generation process is started, the image generation unit 102 and the sound generation unit 103, based on the scenario data 93 identifier transmitted from the schedule unit 105, a plurality of scenario data 93 stored in the recording medium 9. From this, the target scenario data 93 is specified (step S21). The target scenario data 93 is scenario data 93 that is a target for creating edit data (here, a target for creating the recording data 94) as described above.

  Next, the image generation unit 102 and the sound generation unit 103 specify the material data 90 described in the target scenario data 93 one by one while referring to the specified target scenario data 93 (step S22), and record it. Read from the media 9. Further, the read material data 90 is subjected to data processing associated with the material data 90 in the target scenario data 93 to generate edit data (step S23), and the generated edit data is converted to A / V. This is transmitted to the codec unit 104.

  Then, the A / V codec unit 104 generates the recording data 94 by encoding the editing data into the Motion JPEG format by calculation (step S24).

  The image generation unit 102 and the sound generation unit 103 determine whether or not the processing has been completed for all material data 90 described in the target scenario data 93 while referring to the specified target scenario data 93. If there is material data 90 that has not been completed yet (step S25), the process returns to step S22 and the process is repeated.

  On the other hand, when the processing is completed for all the material data 90, the CPU 20 determines Yes in step S25, and uses the predetermined material data 90 among the material data 90 used when creating the recording data 94. Delete (step S26).

  As the material data 90 deleted in step S26, for example, a part of the material data 74 included in the content data 71 can be considered. The material data 74 is data provided by a content provider, and there may be a case where a copyright exists. Therefore, after the creation (original purpose) of the recording data 94 is achieved, it is preferable to delete the data from the recording medium 9 so that the data is not illegally copied. It is assumed that an identifier indicating that the material data 90 to be deleted in step S26 is to be deleted is added in advance.

  When the deletion of the material data 90 is completed, the A / V codec unit 104 stores the recording data 94 created by repeating Step S24 in the recording medium 9 (Step S27). As a result, the recording data 94 is stored in the recording medium 9.

  As described above, in the digital still camera 2 according to the present embodiment, the idle time of the CPU 20 is detected by the schedule unit 105 in a state where the power is turned on (a situation where various processes can be executed), and the idle time is detected. Only when the recording data 94 is generated. Accordingly, the recording data 94 can be created by the CPU 20 (A / V codec unit 104) without preventing the CPU 20 from executing other processes.

  When step S27 is executed and the recording data 94 is stored in the recording medium 9, the scheduling unit 105 deletes the identifier of the target scenario data 93 from the management data 95. Then, the digital still camera 2 ends the recording data generation process, returns to the process shown in FIG. 4, and enters the monitoring state again.

  In the monitoring state, when the user operates the operation unit 22 to turn off the power of the digital still camera 2, the CPU 20 inputs an instruction for the user to end all processing in the digital still camera 2. It determines with having carried out, it determines with Yes in step S6 shown in FIG. 4, and complete | finishes all the processes.

  As described above, the digital still camera 2 according to the first embodiment detects the idle time when the CPU 20 is not executing another task, and the code by the A / V codec unit 104 is detected when the idle time is detected. The recording data 94 is created by executing the digitizing process. As a result, even if no dedicated hardware is provided, the recording data 94 can be created without hindering the execution of normal photographing processing or the like.

  The cable 30 and the communication unit 29 are not limited to the USB cable and the USB terminal as long as the function of acquiring the content data 71 from the terminal device 3 can be realized. For example, it may be configured by a cradle dedicated to the digital still camera 2 and a flexible terminal to which the cradle is connected.

  The configuration for acquiring the content data 71 in the digital still camera 2 is not limited to the configuration via the terminal device 3. For example, the digital still camera 2 employs a communication unit 29 having a wireless communication function and connects to the network 8 as necessary to download the content data 71 directly from the server device 7 to the digital still camera 2. Also good. As a configuration of the communication unit 29 that realizes such a wireless communication function, it is possible to adopt a communication standard such as WiFi (Wireless Fidelity) or infrared communication.

  Further, the content data 71 used in the digital still camera 2 has been described as being provided by the server device 7 via the network 8 and the terminal device 3, but may be provided by the recording medium 9, for example. That is, the recording medium 9 storing the content data 71 may be distributed at a store or the like, and may be configured to be used by being attached to the digital still camera 2.

<2. Second Embodiment>
The image processing system in the first embodiment is configured as the digital still camera 2 and has been described as a system having an imaging function (imaging unit 24). That is, the image processing system has a function of creating (imaging and recording) the material data 90 and creating the recording data 94, but the present invention is limited to the image processing system having such a system configuration. It is not a thing.

  FIG. 7 is a diagram illustrating an information processing system 1a according to the second embodiment. The information processing system 1a includes a computer 4 configured as an image processing system according to the present invention and a digital still camera 5. Moreover, the information processing system 1a in 2nd Embodiment is provided with the server apparatus 7 similar to the information processing system 1 in 1st Embodiment, as shown in FIG. About the server apparatus 7 and the network 8, since the structure similar to 1st Embodiment can be employ | adopted, description is abbreviate | omitted below. Although details will be described later, in the information processing system 1a, the digital still camera 5 creates the material data 90, and the computer 4 creates the encoded recording data 94.

  FIG. 8 is a block diagram showing a configuration of the computer 4 configured as an image processing system in the second embodiment. The computer 4 includes a CPU 40, a ROM 41, a RAM 42, and a hard disk 43, which will be described later in detail, but is configured as an image processing system in the present invention.

  The CPU 40 controls each component of the computer 4 by operating according to the program 410 stored in the ROM 41. The function and operation of the CPU 40 will be described later.

  The ROM 41, the RAM 42, and the hard disk 43 constitute a storage device included in the computer 4 and store various data. The ROM 41 is a read-only storage device and mainly stores the program 410. The RAM 42 is a storage device that can be accessed at a relatively high speed, and is used as a temporary working area of the CPU 40. The hard disk 43 is a storage device capable of storing a relatively large amount of data. A part of the program 410 may be stored in the hard disk 43. That is, the CPU 40 may read and execute the program 410 stored in the hard disk 43 to the RAM 42 as necessary.

  The operation unit 44 is hardware including a keyboard (buttons and keys) operated by a user, a pointing device (mouse and touch panel), various switches, and the like. The user operates the operation unit 44 when giving any instruction to the computer 4. That is, the user can input various data (instructions) to the computer 4 by operating the operation unit 44.

  The speaker 45 is a general device for reproducing sound. The speaker 45 has a function of reproducing sound in accordance with an electric signal generated based on sound data (data related to sound in the recording data 92 or editing data).

  The display 46 corresponds to a liquid crystal display, a CRT, or the like, and is a device that displays various data as images on a screen.

  The USB terminal 47 has a shape necessary to connect to one end of the cable 31, and data in accordance with the USB standard is used between the computer 4 and the digital still camera 5 connected to the other end of the cable 31. Used for communication. That is, when the digital still camera 5 is connected to the USB terminal 47 via the cable 31, the computer 4 appropriately stores data (for example, image data 91 and recording data 92) stored in the digital still camera 5. It can be referred to or copied to the hard disk 43.

  The communication unit 48 provides a function of connecting the computer 4 to the network 8. Thus, the computer 4 can perform data communication with the server device 7 via the network 8.

  FIG. 9 is a diagram illustrating functional blocks of the computer 4 configured as an image processing system in the second embodiment together with a data flow. The request unit 100a, the scenario analysis unit 101, the image generation unit 102, the audio generation unit 103, the A / V codec unit 104, and the schedule unit 105 illustrated in FIG. 9 are functional blocks realized by the CPU 40 operating according to the program 410. is there.

  The scenario analysis unit 101, the image generation unit 102, the audio generation unit 103, the A / V codec unit 104, and the schedule unit 105 are the same as the functional blocks realized in the digital still camera 2 according to the first embodiment. Therefore, the same reference numerals are given, and the description is omitted.

  While referring to the GUI data 73, the request unit 100a provides a GUI that prompts the user of the computer 4 to input necessary information according to the contents described therein. That is, the request unit 100a requests the user to input specific information for specifying pre-edit data required in the scenario source data 72 by displaying a menu screen, an input screen, or the like on the display 46. It has a function to do.

  The request unit 100a causes the display 46 to display a list of material data 90 already stored in the hard disk 43 as selection candidates. At this time, if the digital still camera 5 is connected, the request unit 100 a communicates with the digital still camera 5 via the USB terminal 47 and the cable 31, and the imaging data 91 stored in the digital still camera 5. The recorded data 92 is also displayed on the display 46 as a selection candidate.

  Also in the second embodiment, as in the first embodiment, the user inputs specific information as to which data is specifically assigned to the pre-edit data described in the scenario source data 72. Determined by. When the user inputs according to the GUI screen provided by the GUI data 73, the identifier of the designated material data 90 and the identifier of the pre-edit data are associated with each other.

  When the image data 91 or the recording data 92 stored in the digital still camera 5 is designated, the designated data is transferred from the digital still camera 5 to the hard disk 43 as material data 90. Then, the identifier of the material data 90 after the transfer and the identifier of the pre-edit data are associated by the request unit 100a.

  As described above, also in the second embodiment, the user only has to input information required by the GUI screen displayed on the display 46 by operating the operation unit 44 according to the GUI screen. Even if the user does not have knowledge, it is possible to give the computer 4 instructions necessary for creating the editing data.

  However, the request unit 100a in the present embodiment only requests to select the material data 90 that is the pre-edit data from the already collected data. That is, as shown in the first embodiment, the material collection instruction information is displayed on the display 46 as a GUI screen, thereby requesting the user to acquire new material data 90 as pre-edit data. There is no. Accordingly, there is no need to newly acquire the image data 91 or the recording data 92 by performing image capturing or recording.

  Each material data 90 selected in accordance with an instruction from the user is regarded as specified by the user as each pre-edit data declared in the scenario original data 72, and is associated with each other, and the information is stored in the request part. 100a is transmitted to the scenario analysis unit 101. That is, at the stage where the user designation for all the pre-edit data is completed, the request unit 100a determines the pre-edit data identifier requested by the scenario source data 72 and the hard disk of each material data 90 stored in the hard disk 43. 43, the material designation information associated with the identifier on 43 (for example, the file name of each material data 90 in the hard disk 43) is transmitted to the scenario analysis unit 101.

  Returning to FIG. 7, the digital still camera 5 is configured so that a recording medium 9 as a recording medium can be mounted and used. In addition, the digital still camera 5 includes a terminal (not shown) that can be connected to one end of a cable 31 compliant with the USB standard, and data communication compliant with the USB standard is performed between the computer 4 and the computer 4. It is possible to execute.

  Although the digital still camera 5 has an imaging function for acquiring the imaging data 91 and a recording function for acquiring the recording data 92, the digital still camera 5 can be realized by adopting a commercially available general digital still camera. Omitted.

  The above is the description of the configuration and functions of the information processing system 1a according to the second embodiment. Next, an image processing method in the second embodiment realized using the information processing system 1a will be described.

  FIG. 10 is a flowchart illustrating an image processing method according to the second embodiment. By the time the processing of FIG. 10 is started, the computer 4 has already been activated by the user and has transitioned to a monitoring state (a state in which various tasks can be performed), and the computer 4 is connected to the network 8. It is assumed that

  In the monitoring state, the CPU 40 of the computer 4 appropriately executes processing (tasks) other than the processing shown in FIG. 10 and is instructed to create a scenario (step S31), or has the CPU 40 detected a free time (step S33)? ) And whether the end of processing is instructed (step S36).

  When the user operates the operation unit 44 of the computer 4 in the monitoring state and gives an instruction to create the scenario data 93 to the computer 4, the CPU 40 determines Yes in step S31. As a result, the scenario data creation process is selected as a task to be executed by the CPU 40, and the process is started (step S32).

  FIG. 11 is a flowchart showing scenario data creation processing in the second embodiment. Also in the second embodiment, the content data 71 in the server device 7 is designated by the user by a procedure substantially similar to that in the first embodiment.

  As a result, the designated content data 71 (scenario original data 72, GUI data 73, and material data 74) is downloaded to the computer 4 (step S41) and stored in the hard disk 43.

  When the download is completed, the user operates the operation unit 44 to instruct the start of designated work (step S42). In response to this instruction, the request unit 100a refers to the GUI data 73 stored in the hard disk 43, and causes the display 46 to display a GUI screen (selection screen) that prompts the user for necessary input (step S43).

  The selection screen displayed on the display 46 in step S43 is a list of data indicating characteristics of pre-edit data to be specified on the selection screen and data (selection candidate data) that can be selected as the pre-edit data. . The data indicating the characteristics of the pre-edit data is, for example, pre-edit data required as an image representing a scene in which the bride and groom are exchanging rings in the theme “wedding”. Then, character data such as “ring exchange (photo)” can be considered. In addition, even in the same scene, text data such as “ring exchange (BGM)” is conceivable as long as it is pre-edit data required as sound.

  When executing step S43, the request unit 100a detects whether or not the digital still camera 5 is connected to the USB terminal 47 via the cable 31. When the digital still camera 5 is connected, not only the material data 90 stored in the hard disk 43 but also the imaging data stored in the digital still camera 5 as selectable data on the selection screen. 91 and recorded data 92 are also displayed.

  The user inputs specific information from the list displayed on the selection screen by selecting optimum data as pre-edit data specified on the selection screen (step S44).

  Thereby, one pre-edit data required in the scenario source data 72 is identified from the material data 90, and the designated material data 90 and pre-edit data are associated (step S45). That is, each time step S45 is executed, one pre-edit data is identified and one record of material designation information is created. If the data selected in step S44 is the imaging data 91 or the recording data 92 stored in the digital still camera 5, these data are copied to the hard disk 43 as the material data 90, Association in step S45 is performed.

  When step S45 is executed, the request unit 100a determines whether or not the specification for all the pre-edit data has been completed (step S46). If there is pre-edit data that has not been specified yet, the request unit 100a proceeds to step S43. Return and repeat the process.

  On the other hand, when the specification for all the pre-edit data is completed, the scenario analysis unit 101 refers to the material designation information transmitted from the request unit 100a and the scenario source data 72 stored in the hard disk 43. Then, each material data 90 specified as pre-edit data is associated with data processing to be executed for each material data 90, and scenario data 93 is generated and stored in the hard disk 43 (step S47). In step S47, as in the first embodiment, the schedule unit 105 registers the identifier of the scenario data 93 generated in step S47 in the management data 95.

  When step S47 ends, the CPU 40 of the computer 4 ends the scenario data creation process, returns to the process shown in FIG. 10, and returns to the monitoring state again.

  When the CPU 40 detects a free time in the monitoring state, the CPU 40 determines Yes in step S33. At this time, the CPU 40 (schedule unit 105) further refers to the management data 95 to determine whether or not the scenario data 93 is registered (step S34).

  When the scenario data 93 is registered in the management data 95 (Yes in step S34), the CPU 40 executes a recording data generation process (step S35). Note that the recording data generation process in the second embodiment can be executed in the same manner as the recording data generation process (FIG. 6) in the first embodiment, and thus the description thereof is omitted.

  On the other hand, when the scenario data 93 is not registered in the management data 95 (No in step S34), for example, even if the CPU 40 detects the free time of the CPU 40, it is not necessary to create the recording data 94. To return to the monitoring state.

  In the monitoring state, when the user operates the operation unit 44 and is instructed to end all processing by the computer 4, the CPU 40 determines Yes in step S36 shown in FIG.

  The CPU 40 in the present embodiment does not immediately switch the power supply to the OFF state when an instruction to end all the instructions by the computer 4 is given, but the schedule unit 105 refers to the management data 95 so that the power is turned off. At the time, it is determined whether or not the scenario data 93 registered in the management data 95 still remains (step S37).

  When the scenario data 93 registered in the management data 95 does not exist at the time when step S37 is executed (No in step S37), it is assumed that the scenario data 93 for which the recording data 94 should be created does not already exist. The computer 4 is turned off.

  On the other hand, when the scenario data 93 registered in the management data 95 exists at the time when step S37 is executed (Yes in step S37), it is assumed that the scenario data 93 for which the recording data 94 should be created still exists and the recording is performed. Data generation processing is executed (step S38). Then, the process of step S38 is repeatedly executed until it is determined No in step S37 (until the recording data generation process is completed for all scenario data 93 registered in the management data 95). Note that the process of step S38 can be performed in the same manner as the process of step S35, and thus description thereof is omitted.

  As described above, after instructed to finish all the processes in the computer 4, the CPU 40 detects a free time in which another task to be prioritized is not executed, and executes the recording data generation process. Thus, the recording data 94 can be created by the CPU 40 (A / V codec unit 104) without preventing the CPU 40 from executing other processes.

<3. Modification>
Although the embodiments of the present invention have been described above, the present invention is not limited to the above embodiments, and various modifications can be made.

  For example, in the above embodiment, the digital still camera 2 or the computer 4 has been described as an example of the image processing system. However, the image processing system according to the present invention may be configured by a mobile phone. When a mobile phone is employed as the image processing system as described above, the content data 71 may be downloaded from the server device 7 by the communication function of the mobile phone.

  Moreover, although the functional block in the said embodiment was demonstrated by the example implement | achieved by program 210,410 (software), a part or all of the function implement | achieved by these functional blocks is a dedicated logic circuit (hardware). It may be realized as. On the other hand, part or all of the configuration (for example, the data conversion unit 27) described as being configured by a logic circuit in the above embodiment may be realized by software.

  Moreover, the content of the process shown above is an illustration to the last, and if the same effect is acquired, the content, order, etc. of each process may be changed suitably.

  In the above embodiment, the scenario data 93 is created in the image processing system (the digital still camera 2 or the computer 4). However, the scenario data 93 may not be created in the image processing system. For example, the digital still camera 5 may be provided with functional blocks corresponding to the request unit 100 and the scenario analysis unit 101, and the material data 90 may be specified and the scenario data 93 may be created by the digital still camera 5. Thereafter, the created scenario data 93 and necessary material data 90 may be transferred to the computer 4 and registered in the management data 95 so that the recording data 94 is created in the computer 4.

  In the above-described embodiment, the example in which the editing data is generated and the recording data 94 is generated by the same apparatus has been described. That is, the example in which the image generation unit 102, the audio generation unit 103, and the A / V codec unit 104 are mounted on the same device has been described. However, these processes may be performed by separate apparatuses. For example, an image processing system may be configured by a digital still camera including a request unit 100, a scenario analysis unit 101, an image generation unit 102, and an audio generation unit 103, and a computer including an A / V codec unit 104 and a schedule unit 105. Is possible. In this case, editing data may be created by a digital still camera and transferred to a connected computer in accordance with control from the schedule unit 105, and the A / V codec unit 104 of the computer may generate the recording data 94.

  Further, in the above embodiment, it has been described that once the generation of the recording data 94 is started, the process is continued regardless of the occurrence of other tasks. However, while the recording data 94 is being generated (during the execution of the recording data generation process), it is always monitored whether another task has occurred, and if it occurs, the generation of the recording data 94 is temporarily interrupted. It may be configured.

It is a figure which shows the information processing system in 1st Embodiment. It is a block diagram which shows the structure of the digital still camera comprised as an image processing system in 1st Embodiment. It is a figure which shows the functional block of the digital still camera comprised as an image processing system in 1st Embodiment with the flow of data. 3 is a flowchart illustrating an image processing method according to the first embodiment. It is a flowchart which shows the scenario data creation process in 1st Embodiment. It is a flowchart which shows a recording data generation process. It is a figure which shows the information processing system in 2nd Embodiment. It is a block diagram which shows the structure of the computer comprised as an image processing system in 2nd Embodiment. It is a figure which shows the functional block of the computer comprised as an image processing system in 2nd Embodiment with the flow of data. It is a flowchart which shows the image processing method in 2nd Embodiment. It is a flowchart which shows the scenario data creation process in 2nd Embodiment.

Explanation of symbols

2 Digital still camera 20, 40 CPU
100, 100a Request section 101 Scenario analysis section 102 Image generation section 103 Audio generation section 104 A / V codec section 105 Schedule section 21 Storage section 210, 410 Program 22, 44 Operation section 23 Microphone 24 Imaging section 25 Speaker 26 Liquid crystal panel 27 Data Conversion unit 28 Card slot 29 Communication unit 3 Terminal device 4 Computer 43 Hard disk 46 Display 72 Scenario source data 73 GUI data 74, 90 Material data 8 Network 9 Recording medium 91 Imaging data 92 Recording data 93 Scenario data 94 Recording data 95 Management data

Claims (9)

An image processing system for creating recorded data encoded based on material data,
Storage means for storing in advance scenario data indicating a correspondence relationship between requested material data and data processing applied to the requested material data, and material data required in the scenario data;
Based on the scenario data stored in the storage means, the data processing to be performed on the material data required in the scenario data is specified, and the specified data processing is performed on the material data to generate edit data. Generating means for
Calculation means for encoding the edit data generated by the generation means to generate recording data;
Scheduling means for determining a timing at which the computing means starts the encoding so that the computing means detects an idle time during which no task is being executed and the encoding by the computing means is performed during the idle time. When,
An image processing system comprising: The image processing system according to claim 1,
The image processing system according to claim 1, wherein the scheduling unit determines a timing at which the calculation unit starts the encoding by determining a timing at which the generation unit starts generating edited data. The image processing system according to claim 1 or 2,
The image processing system according to claim 1, wherein the schedule means detects the idle time in response to a user operation. The image processing system according to any one of claims 1 to 3,
The image processing system according to claim 1, wherein the schedule unit detects the idle time by monitoring whether or not the calculation unit is executing a task. The image processing system according to claim 4,
The image processing system according to claim 1, wherein the scheduling unit determines that the idle time has been detected when the calculation unit detects that the task is not executed for a predetermined time. An image processing method for creating recording data encoded based on material data,
(a) storing scenario data indicating a correspondence relationship between requested material data and data processing applied to the requested material data and material data requested in the scenario data in a storage unit in advance;
(b) a step of detecting free time when the computing means is not executing a task;
(c) Based on the scenario data stored in the storage means, the data processing to be applied to the material data required in the scenario data is specified, and the specified data processing is applied to the material data for editing. Generating data and transmitting it to the computing means;
(d) When the idle time is detected in the step (b), the editing data transmitted to the calculation unit in the step (c) is encoded by causing the calculation unit to calculate and record the recorded data. Generating step;
An image processing method comprising: The image processing method according to claim 6,
Step (c) is an image processing method that is started in response to the detection of a free time in step (b). A program that is executed by a computer including a storage unit and a calculation unit, and the execution of the program by the computer is performed on the computer,
(a) storing scenario data indicating a correspondence relationship between requested material data and data processing applied to the requested material data and material data required in the scenario data in the storage unit in advance;
(b) detecting a free time when the computing means is not executing a task;
(c) Based on the scenario data stored in the storage means, the data processing to be applied to the material data required in the scenario data is specified, and the specified data processing is applied to the material data for editing. Generating data and transmitting it to the computing means;
(d) When the idle time is detected in the step (b), the editing data transmitted to the calculation unit in the step (c) is encoded by causing the calculation unit to calculate and record the recorded data. Generating step;
A program characterized by having executed. The program according to claim 8, wherein
A program for causing the computer to start the step (c) in response to the detection of a free time in the step (b).

Images