JP2007041718A - Information distribution system, information distribution apparatus, information receiver, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To efficiently distribute information using a mobile communication. <P>SOLUTION: This information distribution device 100 converts information to be distributed with content such as a moving image into a code to prepare a code symbol, and synthesizes the prepared code symbol with moving image data. The moving image data obtained by synthesizing the code symbol are transmitted through a communication network 10 to a mobile communication terminal 200. The mobile communication terminal 200 receives the moving image data distributed from the information distribution equipment 100, and extracts and decodes the synthesized code symbol. When the decoded information is URL, a web site shown by the URL is accessed through the communication network 10. The mobile communication terminal 200 reproduces the moving image data distributed from the information distribution device 100, and displays out the image data or character information acquired by decoding the code symbol and the web page based on the URL. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an information distribution system, an information distribution device, an information reception device, and a program, and in particular, an information distribution system, an information distribution device, and an information reception device suitable for content distribution using a mobile communication terminal such as a mobile phone. And related to the program.

  Due to the development of electronic technology and communication technology, information communication is also advanced in mobile communication such as mobile phones, and it is also possible to reproduce distributed moving images in real time.

  On the other hand, since the demands for user information are diversified, there is a high demand for so-called multimedia that can simultaneously obtain a plurality of types of information. Therefore, in order to improve convenience and user satisfaction, multimedia is also being developed in mobile communications. Conventionally, in order to realize multimedia communication in mobile communication, a technique of transmitting a plurality of types of information by so-called multiplexing has been used (for example, Patent Document 1).

However, since the information to be distributed itself has become more sophisticated, the amount of data tends to increase, and in the conventional information distribution by multiplexing, the transmission efficiency may decrease. In particular, when moving images are distributed, streaming playback that can be played back in real time is widely performed, but if a large amount of information is multiplexed at the time of streaming playback, the transmission efficiency is reduced and good playback quality cannot be obtained. There is. Therefore, in particular, in mobile communication with a relatively low communication speed, establishment of a technique that can distribute more information without reducing transmission efficiency is desired.
Japanese Patent Laid-Open No. 10-51495

  The present invention has been made in view of the above circumstances, and an object thereof is to provide an information distribution system or the like that enables efficient information distribution to a mobile communication terminal or the like.

In order to achieve the above object, an information distribution system according to the first aspect of the present invention includes:
An information distribution system for distributing content including a plurality of types of information, comprising an information distribution device and an information reception device connected via a communication network,
The information distribution apparatus includes:
Content data creation means for creating content data obtained by synthesizing any of the plurality of types of information into code symbols;
Distribution means for distributing content data in which the code symbolized information is combined to the information receiving device via the communication network;
The information receiving means includes
Receiving means for receiving content data distributed by the information distribution device via the communication network;
Output means for obtaining information that has been converted into code symbols combined with the content information received by the receiving means, and outputting the information together with the received content;
It is characterized by that.

In order to achieve the above object, an information distribution apparatus according to the second aspect of the present invention provides:
Information acquisition means for acquiring a plurality of types of information to be distributed;
Code conversion means for code-converting any of the plurality of types of information acquired by the information acquisition means;
Code image generation means for generating a code image indicating the code converted by the code conversion means;
Code image synthesizing means for synthesizing the code image with information that has not been subjected to code conversion by the code converting means;
Information transmitting means for transmitting information obtained by combining the code image by the code image combining means to a predetermined receiving device via a communication network;
It is characterized by providing.

In the above information distribution apparatus,
The information acquisition means acquires at least moving image data;
It is desirable that the code image synthesizing unit synthesizes the code image with the moving image data.

In the above information distribution apparatus,
The information transmitting means may transmit the information by multicast transmission.

In order to achieve the above object, an information receiving apparatus according to the third aspect of the present invention provides:
Information receiving means for receiving information distributed by a predetermined information distribution device via a communication network;
A code image extracting means for extracting the code image when a predetermined code image is synthesized with the information received by the information receiving means;
Code decoding means for decoding the code image extracted by the code image extraction means;
Information acquisition means for acquiring at least one or more information based on decoding by the code decoding means;
Information output means for simultaneously outputting the information acquired by the information acquisition means and the information in which the code image is synthesized;
It is provided with.

In the information receiving apparatus,
The distributed information is moving image data, and in this case,
The code image extraction means extracts a code image synthesized with a frame image indicated by the moving image data,
The information output means preferably outputs the information acquired by the information acquisition means simultaneously with the reproduction of the moving image data.

In the information receiving apparatus,
The information acquisition means includes
When predetermined address information is acquired based on decoding of the code image, it is desirable to further include communication means for performing communication via the communication network based on the address information.
It is desirable to acquire information by communication of the communication means.

In the information receiving apparatus,
The information output means preferably further includes a display means for displaying and outputting information received by the information receiving means and information acquired by the information acquiring means.

  The information receiving device is preferably configured by a mobile communication terminal.

In order to achieve the above object, a program according to the fourth aspect of the present invention is:
On the computer,
The ability to obtain multiple types of information,
A function of transcoding any one of the acquired types of information;
A function for generating a code image showing the converted code;
A function of synthesizing the code image with information that has not been subjected to code conversion;
A function of transmitting information obtained by combining the code images to a predetermined receiving device via a communication network;
It is characterized by realizing.

In order to achieve the above object, a program according to the fifth aspect of the present invention is:
A function of receiving information distributed from a predetermined information distribution device via a communication network;
When a predetermined code image is synthesized with the received information, a function of extracting the code image;
A function to decode the extracted code image;
A function of acquiring at least one or more information based on decoding of the code image;
When predetermined address information is acquired based on the decoding of the code image, a function of acquiring information by performing communication via the communication network based on the address information;
A function of simultaneously outputting information acquired based on decoding of the code image and information in which the code image is combined;
It is characterized by realizing.

  According to the present invention, multiple types of information are converted into code images (for example, code symbols such as two-dimensional codes), synthesized into moving image data, and distributed, so that multiple types of information can be distributed efficiently. be able to.

  Embodiments according to the present invention will be described below with reference to the drawings. First, an information distribution system to which the present invention is applied will be described. FIG. 1 is a diagram showing a configuration of an information distribution system 1 according to the present embodiment. As shown in the figure, an information distribution system 1 according to the present embodiment includes an information distribution device 100 and a mobile communication terminal 200. The information distribution device 100 and the mobile communication terminal 200 are connected to a communication network 10 and The base stations 20 are interconnected.

  Here, the mobile communication terminal 200 is a mobile communication terminal device (telephone) such as a mobile phone or PHS (Personal Handyphone System), and is operated by a provider (such as a carrier) that provides a communication service. The communication network 10 and the base station 20 are connected to perform communication (voice call and data communication).

  In addition, the information distribution apparatus 100 is operated by, for example, an entity that has previously contracted with a communication carrier (carrier) or the like, and provides an information distribution service to the mobile communication terminal 200 using a communication service provided by the carrier. To do.

  In this case, for example, the information distributed from the information distribution apparatus 100 is transmitted to the carrier center (not shown) via the communication network 10 and then transmitted from the center to each base station 20 via the communication network 10. The Here, the communication network 10 is a communication network for transmitting data based on a predetermined communication protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol). The base station 20 has a predetermined wireless communication function, and transmits information received via the communication network 10 to the mobile communication terminal 200 by wireless communication. Note that the information distribution apparatus 100 may be operated by a carrier, and in this case, the information distribution apparatus 100 may be configured at the center of the carrier.

  The configurations of the information distribution apparatus 100 and the mobile communication terminal 200 that constitute such an information distribution system 1 will be described below. First, the configuration of the information distribution apparatus 100 will be described with reference to FIG. FIG. 2 is a block diagram illustrating a configuration of the information distribution apparatus 100. As illustrated, the information distribution apparatus 100 includes a material data acquisition unit 110, a content creation unit 120, a web server unit 130, and the like.

  The material data acquisition unit 110 includes a moving image acquisition device 111, an image acquisition device 112, a content material DB 113, and the like. The material data acquisition unit 110 acquires data (material data) that configures content of information distributed by the information distribution device 100, and content. This is provided to the creation unit 120.

  The moving image acquisition device 111 is composed of, for example, a video camera and acquires moving image data when video content is distributed.

  The image acquisition device 112 is composed of, for example, a scanner device and acquires image data when distributing image content.

  The content material DB 113 is a database device configured from a storage device such as a hard disk device, for example, and accumulates data of content materials (moving images, images, text, etc.) that have already been created.

  The content creation unit 120 includes a switching unit 121, an input unit 122, a code symbol creation unit 123, an image composition unit 124, a content DB 125, and the like. The content creation unit 120 uses the material data provided from the material data acquisition unit 110 to Content to be distributed to the communication terminal 200 is created and provided to the web server unit 130.

  For example, the switching unit 121 determines whether the content is main data or sub-data (details will be described later) of the content to be distributed according to the type of content data provided from the material data acquisition unit 110. In response, the data path is switched so that the provided content data is input to either the input unit 122 or the image composition unit 124.

  Here, the information distribution apparatus 100 according to the present embodiment distributes code data such as a two-dimensional code superimposed on content data to be distributed (moving image or the like). For example, a code symbol in which other information related to the product is encoded is superimposed and distributed on the video of the product advertisement. That is, so-called multimedia distribution is performed in which a plurality of types of information are distributed simultaneously. In this case, in this embodiment, data constituting the content directly provided at the time of distribution is referred to as “main data”, and data constituting the content to be encoded and distributed is referred to as “sub data”.

  The input unit 122 inputs information to be coded and provides it to the code symbol creation unit 123. The input unit 122 inputs the sub data provided from the material data acquisition unit 110 by switching by the switching unit 121, and for example, character information (for example, text, URL (Uniform Resource Locator), etc.) by an input device such as a keyboard. Address information).

  The code symbol creation unit 123 is an encoder for creating a code symbol such as a two-dimensional code, for example, and performs code conversion (coding) by encoding the information input by the input unit 122, and the converted code A code symbol (code image) is created. In the present embodiment, a two-dimensional code such as a QR code (registered trademark) is created as a code symbol.

  The image synthesis unit 124 synthesizes the main data provided from the material data acquisition unit 110 by switching of the switching unit 121 and the image data indicating the two-dimensional code created by the code symbol creation unit 123. In the present embodiment, moving image data is used as main data. In this case, a two-dimensional code is synthesized in an image constituting a video by the image synthesis unit 124. Thereby, content data to be distributed by the information distribution apparatus 100 to the mobile communication terminal 200 is created.

  The content DB 125 is composed of a hard disk device, for example, and stores content data created by the image composition unit 124. The content DB 125 may store content data encoded by the encoding unit 131 (details will be described later) of the web server unit 130.

  The web server unit 130 provides a website that serves as an interface for an information distribution service provided by the information distribution apparatus 100. In the present embodiment, it is assumed that content data is distributed through a session with the mobile communication terminal 200 via a website provided by the web server unit 130. Therefore, the web server unit 130 includes an encoding unit 131, a communication unit 132, and the like, and transmits the content data created by the content creation unit 120 to the mobile communication terminal 200 via the communication network 10.

  The encoding unit 131 encodes the content data created by the content creation unit 120 using a predetermined data compression method. Here, in the present embodiment, it is assumed that content using moving image data indicating video as main data is distributed. In this case, the encoding unit 131 performs encoding based on a moving image encoding method such as MPEG-4 (Motion Picture Experts Group 4). When content is distributed so that only a specific user can view it, the encoding unit 131 performs encryption using a predetermined encryption method (for example, a public key encryption method).

  The communication unit 132 includes a predetermined communication device such as a NIC (Network Interface Card) or a router, and communicates with the mobile communication terminal 200 by connecting the information distribution device 100 and the communication network 10. In this case, the communication unit 132 receives an information distribution request from the mobile communication terminal 200, transmits content data, and the like.

  The web server unit 130 has a configuration and a function necessary for providing a website in addition to these configurations. For example, a web page is dynamically created in conjunction with a database or the like by a web server technology such as CGI (Common Gateway Interface), ASP (Active Server Pages), SSI (Server Side Include), or the like.

  Here, as an information distribution method for the mobile communication terminal 200, for example, a multicast method for distributing to a specific number can be adopted. In this case, the communication unit 132 may include a database that stores information (address information or the like) for specifying the mobile communication terminal 200 to be distributed. Then, based on the address information recorded in the database, the content data is distributed to the mobile communication terminal 200 to be distributed.

  Next, the configuration of the mobile communication terminal 200 according to the present embodiment will be described. The mobile communication terminal 200 according to the present embodiment has a data communication function and a moving image playback function in addition to a voice call function that is a basic function, and receives information (content) distributed by the information distribution apparatus 100. Functions as an information receiving device. Hereinafter, the configuration of the mobile communication terminal 200 will be described with reference to FIG. FIG. 3 is a block diagram showing an internal configuration of the mobile communication terminal 200 according to the present embodiment. As illustrated, the mobile communication terminal 200 includes a communication unit 210, a distribution data processing unit 220, a display control unit 230, an operation unit 240, a telephone unit 250, and the like.

  The communication unit 210 includes a wireless unit 211, an antenna 212, a voice communication processing unit 213, a data communication processing unit 214, and the like, and realizes a communication function of the mobile communication terminal 200.

  The wireless unit 211 includes a predetermined wireless communication circuit and the like, and performs wireless communication between the mobile communication terminal 200 and the base station 20 via the antenna 212.

  The voice communication processing unit 213 performs voice communication related to the call function of the mobile communication terminal 200.

  The data communication processing unit 214 performs transmission / reception processing related to the data communication function of the mobile communication terminal 200. In this embodiment, the content data distributed by the information distribution apparatus 100 is received and provided to the distribution data processing unit 220.

  The distribution data processing unit 220 includes a content decoding unit 221, a content buffer 222, a code symbol extraction unit 223, a code symbol decoding unit 224, and the like, and performs processing necessary for reproducing content data distributed by the information distribution apparatus 100. Do it.

  The content decoding unit 221 is a decoder for decoding (decoding) the content data received by the data communication processing unit 214. In the present embodiment, the content decoding unit 221 uses a decoding method corresponding to the content data encoding method by the information distribution apparatus 100. Decrypt the content data.

  The content buffer 222 is composed of, for example, a semiconductor storage device such as a RAM (Random Access Memory), and temporarily stores the moving image data decoded by the content decoding unit 221.

  The code symbol extraction unit 223 includes a predetermined image processing circuit and the like, and extracts a code symbol (two-dimensional code) image synthesized with the video content (main data) created by the information distribution apparatus 100.

  The code symbol decoding unit 224 is a decoder for decoding (decoding) the code symbol image extracted by the code symbol extraction unit 223. In this embodiment, the code symbol decoding unit 224 is a decoding method corresponding to the two-dimensional code created by the information distribution apparatus 100. The code symbol is decoded in step 1 to obtain the encoded original data (sub data). The code symbol decoding unit 224 also sends the data to the data communication processing unit 214 or the display control unit 230 according to the type of the acquired sub data.

  The display control unit 230 includes a display buffer 231 and a display unit 232, and displays and outputs various information. In the present embodiment, in particular, display output of content (video, image, etc.) distributed by the information distribution apparatus 100 is performed.

  The display buffer 231 is composed of, for example, a semiconductor storage device such as a RAM, and temporarily stores the content image decoded by the content decoding unit 221 and the subdata extracted by the code symbol decoding unit 224.

  The display unit 232 includes, for example, a liquid crystal display device, and displays and outputs an image stored in the display buffer 231.

  Note that the display control unit 230 has a configuration and a function necessary for controlling display on the display unit 232 in addition to the above-described configurations. For example, a plurality of display areas are set on the display unit 232, and the display unit 232 is controlled so that different information is displayed in each display area.

  The operation unit 240 includes, for example, keys and buttons configured on the outer surface of the mobile communication terminal 200, and inputs user instructions and the like when operated by the user.

  The telephone unit 250 includes, for example, a predetermined codec circuit and performs input / output related to the call function of the information distribution apparatus 100. In other words, the audio data received by the audio communication processing unit 213 is decoded (decoded) and output from the speaker 251, and the audio input to the microphone 252 is encoded and transmitted to the data communication processing unit 214, so that digital Realize voice communication.

  The above is the main configuration of the mobile communication terminal 200 according to the present embodiment. Note that each of the above-described configurations has been described with a focus on the configuration necessary for realizing the present invention by the mobile communication terminal 200, and detailed description of other configurations will be omitted. That is, the mobile communication terminal 200 is provided with a configuration for realizing a basic function or an additional function as a mobile communication terminal as necessary, in addition to the above-described configurations.

  In addition, each of the configurations of the mobile communication terminal 200 described above can be realized by hardware processing using a dedicated circuit or the like, for example, software by an arithmetic device such as a CPU (Central Processing Unit). It may be logically realized by processing. In this case, the mobile communication terminal 200 is provided with a program storage unit for storing a program, which is configured by a storage device such as a flash memory, for example, and a program stored in the program storage unit by the CPU or the like. When executed, it functions as each of the above components.

  Processing performed by the information distribution system 1 having the above configuration will be described below. First, content creation processing for creating content data by the information distribution apparatus 100 will be described with reference to the flowchart shown in FIG. This content creation process is started, for example, when the material data is provided to the content creation unit 120 by the material data acquisition unit 110.

  When the material data is provided to the content creation unit 120, the switching unit 121 determines whether the provided data is sub-data (step S101). In this embodiment, as an example, moving image data indicating a video is used as main data, and other data (such as still image data and text data) is used as sub data. In this case, the switching unit 121 determines whether the data is sub-data according to the type of provided data. Here, for example, the type of data to be main data or sub data is set in advance for each content, and the switching unit 121 determines whether the data provided based on the setting is main data or sub data. Is determined.

  Here, when the provided data is main data such as moving image data (step S101: No), the switching unit 121 supplies the data to the image composition unit 124 (step S102). On the other hand, when the sub data is provided (step S101: Yes), the switching unit 121 supplies the sub data provided from the content creation unit 120 to the code symbol creation unit 123 via the input unit 122, and the sub data is provided. Data is subjected to code conversion (step S103), and a code symbol image (two-dimensional code) is created (step S104). Even when character information or address information (URL or the like) as sub data is input by the input unit 122, the code symbol creating unit 123 converts the information into code symbols. Here, code conversion and code image creation are performed using a creation method based on the code symbol standard adopted. For example, the code symbol creation unit 123 is configured by a CPU or the like, and a code conversion and code image creation program is executed to generate sub-data code symbols.

  When the sub-data is two-dimensionally encoded, the generated code symbol image and the main data (moving image data) provided from the material data acquisition unit 110 are combined by the image combining unit 124 (step S105). Here, for example, a position where a code symbol is synthesized in a frame of a moving image is determined in advance, and pixel data at the position in the acquired frame image is used as pixel data constituting the generated code symbol image. The code symbol image is synthesized with the frame image by conversion. As a result, a frame image in which the code symbol images are synthesized as illustrated in FIG. 5 is generated.

  When the moving image and the code symbol image (two-dimensional code) are combined by the image combining unit 124, the moving image data combined with the code symbol image is stored in the content DB 125 as content data to be distributed (step S106). ), The process is terminated. Here, for example, unique identification information (content ID) indicating the created content data is assigned, and the created content data is stored in a record having the content ID as a primary key. Also, address information (for example, URL) for accessing the content data, attribute information indicating whether encryption is necessary, and the like are set and stored in the content DB 125.

The above processing is content creation processing in the information distribution apparatus 100.
Next, content distribution processing by the information distribution apparatus 100 for distributing the content data created by the content creation processing to the mobile communication terminal 200 will be described with reference to the flowchart shown in FIG. This content distribution process is started when a web site (hereinafter referred to as “distribution site”) for performing content distribution is released by the web server unit 130.

  When the mobile communication terminal 200 accesses the distribution site and the communication unit 132 receives a distribution request by designating content from the accessed mobile communication terminal 200 (step S201: Yes), the web server unit 130 displays the content. The DB 125 is accessed and the content data of the requested content is searched (step S202).

  If the content data of the requested content is not in the content DB 125 (step S203: No), the web server unit 130 creates a web page indicating that the content cannot be distributed, and transmits the web page to the access source mobile communication terminal 200. Then, a distribution impossible notification is made (step S204).

  On the other hand, when the requested content data is in the content DB 125 (step S203: Yes), the encoding unit 131 encodes the content data using a moving image encoding method such as MPEG-4 (step S205). Also, the encoding unit 131 determines whether the content data needs to be encrypted based on the attribute information recorded in the content DB 125 (step S206).

  If encryption is necessary (step S206: Yes), encryption is performed using a predetermined encryption method (step S207).

  The content data encoded by the encoding unit 131 and encrypted as necessary is transmitted from the communication unit 132 to the mobile communication terminal 200 (step S208), and the process ends.

In this way, the information distribution apparatus 100 distributes content data in response to a request from the mobile communication terminal 200.
The above processing is content distribution processing in the information distribution apparatus 100.
Next, processing on the mobile communication terminal 200 side will be described below. A content reception process executed by the mobile communication terminal 200 to receive and play back content will be described with reference to a flowchart shown in FIG. This content reception process is started when the mobile communication terminal 200 accesses the distribution site provided by the information distribution apparatus 100.

  When accessing the distribution site, a screen for designating desired content is displayed on the display unit 232. When the user operates the operation unit 240 to instruct desired content, the data communication processing unit 214 transmits distribution request information for requesting distribution of the content to the information distribution apparatus 100 (step S301).

  When data transmission corresponding to the transmission of the distribution request information is performed by the information distribution apparatus 100, the data communication processing unit 214 receives the information distributed from the information distribution apparatus 100 (step S302).

  If the transmitted information is a notification indicating that distribution is not possible (step S303: No), the desired content is not distributed, and the processing is terminated as it is.

  On the other hand, when the content data (moving image data) of the requested content is received (step S303: Yes), the data communication processing unit 214 sequentially sends the received moving image data to the content decoding unit 221.

  When acquiring the moving image data, the content decryption unit 221 determines whether the data is encrypted (step S304). If encrypted (step S304: Yes), the content decryption unit 221 determines whether or not the mobile communication terminal 200 has a decryption key necessary for decryption (step S305). If it does not have a decryption key (step S305: No), the moving image data cannot be decrypted, and the process is terminated. On the other hand, when it has a decryption key (step S305: Yes), the content decryption unit 221 decrypts the acquired moving image data with the decryption key (step S306).

  The content decryption unit 221 decodes the moving image data that has been decrypted or the moving image data that has not been encrypted by a method corresponding to the encoding method employed for the moving image data (step S307). ), A plurality of frame images constituting the moving image are sequentially developed in the content buffer 222 (step S308).

  The code symbol extraction unit 223 sets an initial value 1 indicating the first frame to a counter value i that specifies the frame images developed in the content buffer 222 in sequence order (step S309), and sets the i-th frame image ( Frame data) is acquired from the content buffer 222 (step S310).

  Then, the code symbol extraction unit 223 determines whether or not the acquired frame image is a frame (so-called “I picture”) that has been intra-encoded in moving image encoding (step S311). Here, based on, for example, header information added in units of frames, it is determined whether or not the frame is an I picture.

  If the acquired frame image is not an I picture (step S311: No), the code symbol extraction unit 223 stores the frame image data in the display buffer 231 (step S312).

  On the other hand, when the acquired frame image is an I picture (step S311: Yes), a code symbol decoding process for acquiring information from a code symbol (two-dimensional code) synthesized with a moving image is executed (step S400). ). Here, in general video encoding, inter-frame differential encoding by motion compensation is used, and inter-frame differential encoding (inter encoding) is applied to a frame in which a sequence start or a scene change occurs. In other words, when code symbols are combined with moving images in the information distribution apparatus 100, code symbol images are always combined with I pictures. Therefore, the code symbol extraction unit 223 performs code symbol decoding processing on the I picture.

  Details of the code symbol execution processing will be described with reference to the flowchart shown in FIG. When the processing is started, the code symbol extraction unit 223 performs image processing on the frame image of the I picture, thereby determining whether an image indicating a code symbol (two-dimensional code) is synthesized in the frame image. Is determined (step S401). Here, the code symbol is detected by detecting a predetermined position detection pattern (for example, a cut-out symbol in QR Code (registered trademark)) set in advance according to the code symbol by a method such as pattern matching. It is determined whether or not they are combined.

  If the code symbol is not synthesized with the frame image (step S401: No), the code symbol extracting unit 223 does not synthesize the code symbol in the sequence until at least the next I picture appears. The code symbol decoding process is terminated. In this case, the code symbol extraction unit 223 stores the frame image in the display buffer 231 (step S408), and returns to the flow of content reception processing shown in FIG. 7 (details will be described later).

  On the other hand, when a code symbol is synthesized in the frame image (step S401: Yes), the code symbol extraction unit 223 cuts out and extracts the code symbol portion image from the frame image (I picture) (step S401). S402). Here, for example, based on the position of the position detection pattern (finder pattern) described above, the position (range) where the code symbol is synthesized in the frame image is recognized, and pixel data within the range is acquired. Then, the code symbol image is extracted.

  When the code symbol portion is cut out, the code symbol decoding unit 224 performs image processing on the extracted code symbol image, thereby decoding (decoding) the code symbol (two-dimensional code) (step S403). The encoded information (sub data) is acquired (step S404). Here, the code symbol is decoded by a decoding method based on the adopted code symbol standard. For example, the code symbol decoding unit 224 is configured by a CPU or the like, and the code symbol is decoded by executing a code symbol decoding program.

  When the information is acquired from the code symbol, the code symbol decoding unit 224 determines whether the acquired information is URL information (step S405). Here, when the acquired information is, for example, an image (step S405: No), the code symbol decoding unit 224 associates the data with the frame image data and stores them in the display buffer 231 (step S408). ), The process is terminated. That is, the acquired data is stored in the display buffer 231 in association with the moving image data in which the code symbol in which the data is encoded is synthesized.

  If the sub data acquired from the code symbol is a URL (step S405: Yes), the code symbol decoding unit 224 sends the acquired URL data to the data communication processing unit 214 and the display buffer 231. In this case, the data communication processing unit 214 accesses the web page indicated by the URL acquired from the code symbol decoding unit 224 (step S406), and acquires web page data constituting the web page (step S407). The data communication processing unit 214 stores the acquired web page data and frame image data in association with each other in the display buffer 231 (step S408), and ends the process. In this case, the web page data obtained by accessing the URL is stored as sub-data in the display buffer 231 in association with moving image data in which a code symbol obtained by encoding the URL is synthesized.

  In this way, whether or not a code symbol is synthesized is determined for the I picture, and if it is synthesized, the code symbol is decoded to obtain sub-data. When the frame image and the acquired sub data are stored in the display buffer 231 (step S408), the process returns to the content reception process flow shown in FIG.

  Here, it is determined whether or not the frame stored in the display buffer 231 in step S312 or the frame stored in the display buffer 231 by the code symbol decoding process is the final frame of the received moving image sequence ( Step S313). In this case, the code symbol extraction unit 223 determines whether the processed frame is the final frame based on, for example, header information added to each sequence unit or header information added to each frame unit. Determine.

  If the frame stored in the display buffer 231 is not the last frame (step S313: No), the code symbol extraction unit 223 increments the counter value i by 1 (step S314), returns to step S310, and acquires the next frame. On the other hand, when the frame stored in the display buffer 231 is the final frame (step S313: Yes), a content display process for displaying the received content or the like is executed (step S500). This content display process is executed by the display control unit 230. Next, details of the content display processing will be described with reference to the flowchart shown in FIG.

  When the process is started, the display control unit 230 refers to the data stored in the display buffer 231 and determines whether or not sub-data is stored in addition to the moving image data that is the main data ( Step S501).

  When the sub data is not stored (step S501: No), that is, when the code symbol (two-dimensional code) is not synthesized with the distributed moving image, the display control unit 230 displays on the display unit 232, A display area for displaying the distributed moving image is set (step S502), and the display unit 232 is controlled so that the frame images stored in the display buffer 231 are sequentially displayed in the set display area. Thereby, the distributed moving image is displayed and output on the display unit 232 (step S503).

  On the other hand, when the sub data is stored in the display buffer 231 (step S501: Yes), the display control unit 230 displays a display area on the display unit 232 so that the moving image of the main data and the sub data can be displayed simultaneously. Set (step S504). That is, at least two or more display areas for displaying main data and a display area for displaying sub data are set on the display unit 232.

  Then, the display control unit 230 controls the display unit 232 so that each of the main data and the sub data stored in the display buffer 231 is displayed in the set display area. As a result, the distributed moving image and the sub-data acquired based on the code symbol synthesized with the moving image are displayed and output on the display unit 232 (step S505).

  A display example in the case of displaying the main data and the sub data is shown in FIG. Here, a case of data distribution for the purpose of product advertisement will be described as an example. In this case, for example, a video of a product image is distributed as main data, and detailed information about the product is distributed as sub-data using code symbols. In this case, for example, image data indicating a product photograph of the product can be used as the sub data. FIG. 10A shows a screen display example in the mobile communication terminal 200 in this case. As shown in the figure, in the display unit 232, two display areas, a display area 233 and a display area 234, are set, and an image video (moving image) as main data is displayed in the display area 233, and a product as sub-data. A photograph (still image) is displayed in the display area 234.

  Further, the sub data provided as the code symbol may include a plurality of types of data. For example, two types of information may be used as sub-data: a product photo showing a product and character information for explaining the product. FIG. 10B shows a screen display example in the mobile communication terminal 200 in this case. As shown in the figure, three display areas 233 to 235 are set in the display unit 232. Then, a moving image as main data is displayed in the display area 233, and among the sub data, a photographic image is displayed in the display area 234, and character information is displayed in the display area 235.

  When the information acquired from the code symbol is a URL, the web page specified by the URL is displayed together with the moving image of the main data. A screen display example in the mobile communication terminal 200 in this case is shown in FIG. As shown in the figure, two display areas 233 and 234 are set in the display unit 232, a moving image as main data is displayed in the display area 233, and a web accessed based on a URL as sub data is displayed. The page is displayed in the display area 234. At this time, the URL acquired as the sub data may be displayed.

  As shown in FIG. 10, a moving image in which code symbols (two-dimensional codes) are combined is displayed in a display area for displaying main data. As a result, similar data can be acquired in a terminal device other than the mobile communication terminal 200 receiving the distribution content. That is, by using a terminal device (for example, a mobile communication terminal) capable of recognizing a code symbol by imaging, the code symbol displayed on the display unit 232 of the mobile communication terminal 200 is imaged. Sub data can be acquired.

  In this way, the distributed content is displayed on the display unit 232 of the mobile communication terminal 200 until a predetermined end event (for example, the end of a moving image sequence or a user's end instruction) (step S506). : No). When a predetermined end event occurs (step S506: Yes), the process ends. In this case, the process returns to the content reception process flow shown in FIG. 7 and all the processes are terminated.

  As described above, according to the above-described embodiment of the present invention, various related data can be provided simultaneously when distributing content to a mobile communication terminal or the like. In particular, even when a moving image having a relatively large amount of data is distributed, a large amount of information can be provided easily and efficiently at the same time. In other words, in streaming distribution widely adopted in general moving image distribution, when information other than moving images is simultaneously provided by multiplexing or the like, if a large amount of information is provided, provision of all information is completed. Not only will it take a long time to complete, but it will also be a transmission load for moving image data. However, if the provided information is converted into code symbols and combined with the moving image, such problems will occur. Content can be distributed without any problem. In addition, by displaying such code symbols together with the reproduced image, the same data can be shared and used by a plurality of devices. In particular, in the case of distributing contents such as advertisements that require a ripple effect, the contents of advertisements can be increased. It is also possible to obtain an effect that it is spread to other users.

  The said embodiment is an example and the application range of this invention is not restricted to this. That is, various applications are possible, and all embodiments are included in the scope of the present invention.

  In the above embodiment, content is distributed in response to a request from the user. However, for example, a so-called push distribution mode in which content distribution is actively performed from the information distribution apparatus 100 side may be employed. In this case, it is also possible to employ multicast transmission that distributes content to a specific number of users. When performing multicast transmission, as described above, a database for storing user information can be configured in the information distribution apparatus 100, and a distribution destination can be determined based on the stored user information. For example, a specific carrier When the information is distributed to the users, the information may be distributed to a specific number of users based on the user information accumulated in the carrier center or the like.

  In the above embodiment, content data created by synthesizing code symbols is stored in the content DB 125. However, the present invention is not limited to this. For example, content data synthesized by code symbols may be distributed in real time. Good. Thereby, for example, in the distribution of live video, various sub-data can be encoded and efficiently provided.

  Moreover, in the said embodiment, although the moving image was illustrated as main data to distribute, the form of the data to distribute is arbitrary. Therefore, still images, character information, web pages, and the like exemplified as sub data may be distributed as main data, and moving image data may be distributed as sub data.

  In the above embodiment, the sub-data is converted into a code symbol such as a two-dimensional code and combined with a moving image. However, the form of the code symbol is arbitrary as long as it can be combined with image data such as a moving image. .

  In the above-described embodiment, code symbols are combined with a moving image and distributed. However, the timing for combining and the time for combining are arbitrary. That is, the mobile communication terminal 200 that has received the distributed content only needs to be able to cut out and recognize the code symbol combined with the content. Therefore, it is not always necessary to combine the code symbol with the entire moving image sequence. Instead, for example, it may be synthesized only in the first frame. In this case, the code symbol can be made substantially invisible while main data is displayed on the mobile communication terminal 200. In this way, for example, in the case of distributing appreciable moving image content (such as a movie), sub-data can be provided without reducing the value of the distribution video.

  Further, a plurality of types of code symbols may be combined with the main data. In this case, for example, the sub-data to be provided can be changed according to the content of the moving image to be reproduced by changing the code symbol to be combined at the time of the scene change in the moving image.

  In the above embodiment, the case where the advertisement video is distributed as the main data has been exemplified, but the content and purpose of the information to be distributed are not limited to this and are arbitrary. For example, when pay content such as a movie is distributed as main data, a distribution service characterized by low cost of pay content by advertising revenue by distributing advertisement image, URL of web page for advertisement etc. as sub data Can be provided.

  In the above embodiment, the creation and distribution of content data are performed by one apparatus (information distribution apparatus 100). For example, the content creation unit 120 and the web server unit 130 are configured as separate apparatuses. You may do it.

  In the above embodiment, the display area is set so that the main data and the sub data are displayed at the same time, but the form of the display area is not limited to this and is arbitrary. For example, the display area of the main data may be set to the entire screen, and the display area of the sub data may be converted into an icon, and display control may be performed so that the sub data is displayed only when the user designates the icon.

  In the above-described embodiment, an example in which the information receiving apparatus according to the present invention is realized by a mobile communication terminal has been described. However, such a mobile communication terminal has a function for realizing the above-described present invention in advance. In addition to being provided as a device, it can be made to function as the mobile communication terminal 200 described above by applying a program to a mobile communication terminal that does not have these functions. In this case, a computer that controls the mobile communication terminal by applying the program for realizing each process by the communication unit 210, the distribution data processing unit 220, and the display control unit 230 to the existing mobile communication terminal. Each of these functions can be realized by executing a program to which (CPU or the like) is applied. That is, such a program is installed in the storage device of the mobile communication terminal, and the control device executes the program, whereby the existing mobile communication terminal can function as the mobile communication terminal 200.

  Similarly, the present invention can be realized by applying such a program to various apparatuses having a content receiving function. That is, the present invention can be applied not only to mobile communication terminals but also to various devices that can receive and output content data distributed via a communication network. Therefore, for example, the present invention may be applied to an arbitrary information processing apparatus such as a PDA (Personal Data Assistance: personal digital assistant) or a personal computer. That is, by applying such a program, the present invention can be realized not only by a dedicated device for realizing the present invention but also by various devices.

  Similarly, the information distribution apparatus 100 described above can be realized by, for example, a general-purpose computer apparatus by applying a program. That is, a program for realizing each function of the information distribution device 100 described above is installed in a storage device of a computer device, and a control device such as a CPU executes the program, whereby the information distribution device 100 described above is executed. Can function as.

  The application method of such a program is arbitrary. For example, the program can be applied to an arbitrary apparatus by providing it via a communication medium such as the Internet, and a predetermined recording medium (for example, a CD-ROM, The program can be stored and distributed and applied to a DVD, a memory card, or the like.

It is a figure showing typically the information distribution system concerning the embodiment of the present invention. It is a block diagram which shows the structure of the information delivery apparatus shown in FIG. It is a block diagram which shows the structure of the mobile communication terminal shown in FIG. It is a flowchart for demonstrating the content creation process concerning embodiment of this invention. It is a figure for demonstrating the content data created by the content creation process shown in FIG. It is a flowchart for demonstrating the content delivery process concerning embodiment of this invention. It is a flowchart for demonstrating the content reception process concerning embodiment of this invention. It is a flowchart for demonstrating the code symbol decoding process performed by the process shown in FIG. It is a flowchart for demonstrating the content display process performed by the process shown in FIG. FIG. 10 is a diagram illustrating a screen display example in the processing illustrated in FIG. 9, where (a) illustrates a display example when a moving image and a still image are displayed, and (b) illustrates a moving image, a still image, and character information displayed. (C) shows a screen display example when a moving image and a web page are displayed.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Information delivery system, 10 ... Communication network, 20 ... Base station, 100 ... Information delivery apparatus, 110 ... Material data acquisition part, 120 ... Content creation part, 121 ... Switching part, 122 ... Input part, 123 ... Code symbol creation , 124 ... Image composition part, 125 ... Content DB, 130 ... Web server part, 131 ... Coding part, 132 ... Communication part, 200 ... Mobile communication terminal, 210 ... Communication part, 211 ... Radio part, 212 ... Antenna 213 ... voice communication processing unit, 214 ... data communication processing unit, 220 ... distribution data processing unit, 221 ... content decoding unit, 222 ... content buffer, 223 ... code symbol extraction unit, 224 ... code symbol decoding unit, 230 ... display Control unit, 231 ... display buffer, 232 ... display unit

Claims (11)

An information distribution system for distributing content including a plurality of types of information, comprising an information distribution device and an information reception device connected via a communication network,
The information distribution apparatus includes:
Content data creation means for creating content data obtained by synthesizing any of the plurality of types of information into code symbols;
Distribution means for distributing content data in which the code symbolized information is combined to the information receiving device via the communication network;
The information receiving means includes
Receiving means for receiving content data distributed by the information distribution device via the communication network;
Output means for obtaining information that has been converted into code symbols combined with the content information received by the receiving means, and outputting the information together with the received content;
An information distribution system characterized by that. Information acquisition means for acquiring a plurality of types of information to be distributed;
Code conversion means for code-converting any of the plurality of types of information acquired by the information acquisition means;
Code image generation means for generating a code image indicating the code converted by the code conversion means;
Code image synthesizing means for synthesizing the code image with information that has not been subjected to code conversion by the code converting means;
Information transmitting means for transmitting information obtained by combining the code image by the code image combining means to a predetermined receiving device via a communication network;
An information distribution apparatus comprising: The information acquisition means acquires at least moving image data;
The code image synthesizing unit synthesizes the code image with the moving image data;
The information distribution apparatus according to claim 2. The information transmitting means transmits the information by multicast transmission;
The information distribution apparatus according to claim 2 or 3, wherein Information receiving means for receiving information distributed by a predetermined information distribution device via a communication network;
A code image extracting means for extracting the code image when a predetermined code image is synthesized with the information received by the information receiving means;
Code decoding means for decoding the code image extracted by the code image extraction means;
Information acquisition means for acquiring at least one or more information based on decoding by the code decoding means;
Information output means for simultaneously outputting the information acquired by the information acquisition means and the information in which the code image is synthesized;
An information receiving apparatus comprising: The distributed information is moving image data,
The code image extraction means extracts a code image synthesized with a frame image indicated by the moving image data,
The information output means outputs the information acquired by the information acquisition means simultaneously with the reproduction of the moving image data.
The information receiving apparatus according to claim 5. The information acquisition means includes
When predetermined address information is acquired based on decoding of the code image, further comprising communication means for performing communication via the communication network based on the address information,
Obtaining information by communication of the communication means;
The information receiving apparatus according to claim 5, wherein the information receiving apparatus is an information receiving apparatus. The information output means further includes display means for displaying and outputting information received by the information receiving means and information acquired by the information acquiring means.
The information receiving apparatus according to claim 5, wherein the information receiving apparatus is an information receiving apparatus. The information receiving device is constituted by a mobile communication terminal.
The information receiving apparatus according to claim 5, wherein the information receiving apparatus is an information receiving apparatus. On the computer,
The ability to obtain multiple types of information,
A function of transcoding any one of the acquired types of information;
A function for generating a code image showing the converted code;
A function of synthesizing the code image with information that has not been subjected to code conversion;
A function of transmitting information obtained by combining the code images to a predetermined receiving device via a communication network;
A program characterized by realizing. A function of receiving information distributed from a predetermined information distribution device via a communication network;
When a predetermined code image is synthesized with the received information, a function of extracting the code image;
A function to decode the extracted code image;
A function of acquiring at least one or more information based on decoding of the code image;
When predetermined address information is acquired based on the decoding of the code image, a function of acquiring information by performing communication via the communication network based on the address information;
A function of simultaneously outputting information acquired based on decoding of the code image and information in which the code image is combined;
A program characterized by realizing.

Images