JP7013289B2 - Information processing systems, information processing methods and programs - Google Patents

Description

Embodiments of the present invention relate to information processing systems, information processing methods and programs.

Conventionally, a technique for selecting and displaying an advertisement moving image for promotion / sales promotion based on a user's preference, a newspaper printing service in which an article is customized according to the user's preference, and the like have been disclosed.

In addition, articles in publications such as newspapers and magazines are usually composed on the premise that they are provided in paper media, but with the spread of the Internet, it has become possible to publish in electronic versions and electronic books. In addition, with the development of automatic voice reading programs, users can choose to obtain information on articles such as electronic versions according to their own tastes via synthetic voice files that read out articles such as electronic versions.

On the other hand, in the newspaper / publishing industry, especially in local newspapers, the decrease in circulation has become a serious problem, and when providing digital content, it is differentiated by competition with portal sites and curated media. There was a case where I was pressed.

Japanese Unexamined Patent Publication No. 2017-182727 Japanese Unexamined Patent Publication No. 2002-298017

"Voice News App Asahi Shimbun Arukiki", [online], [Search January 18, 2018], Internet <URL: http://www.asahi.com/shimbun/medialab/arukiki/)

An object to be solved by the present invention is to provide an information processing system, an information processing method and a program capable of generating attractive contents based on the material information of an existing article.

The information processing system of the embodiment has an extraction unit and a content generation unit. The extraction unit extracts at least one material information from a group of material information of an article that includes at least character information and may include image information based on a predetermined extraction condition. The content generation unit reproduces the image information included in the material information in a predetermined order based on the character information included in the material information extracted by the extraction unit or the creation timing information accompanying the image information. Generate content that includes images.

The schematic diagram which shows the information processing system 1 of 1st Embodiment. The figure which shows an example of the newspaper article which is the generation information source of a moving image. The block diagram of the information processing system 1 of 1st Embodiment. The functional block diagram of the information processing system 1 of 1st Embodiment. The figure which shows an example of the material management table. The figure which shows an example of the customer information management table. The figure which shows another example of the customer information management table. The figure which shows another example of the customer information management table. The figure which shows an example of the whole composition of a moving image. The sequence diagram which shows an example of the content generation processing by an information processing system 1. The block diagram of the information processing system 1A of the 2nd Embodiment. The functional block diagram of the information processing system 1A of the 2nd Embodiment.

Hereinafter, the information processing system, the information processing method, and the program of the embodiment will be described with reference to the drawings.

(First Embodiment)
FIG. 1 is a diagram schematically showing the functions of the information processing system 1 of the first embodiment. The information processing system 1 generates content provided to the client terminal TM via the network NW. In the following description, the content is provided to the client terminal TM via the Web server 500, that is, the information processing system 1 provides the content to the Web server 500, and the Web server 500 responds to the request from the client terminal TM. Shall be provided. The client terminal TM is an information processing device terminal such as a mobile phone such as a smartphone, a tablet terminal, or a personal computer used by a user. In the client terminal TM, a UA (User Agent) such as a browser or an application program is activated to play back the content provided by the Web server 500.

The information processing system 1 refers to the material information S and generates content including a moving image. The material information S is an information source of a moving image generated by the information processing system 1. The material information S is stored, for example, in a storage area in the information processing system 1, a storage area different from the storage area of the information processing system 1 capable of communicating with the information processing system 1, or a cloud computing system.

The network NW may be, for example, a wired communication network such as the Internet, or a wireless communication network such as a wireless LAN (Local Area Network) and a mobile phone communication network. The network NW may be any communication network as long as communication is possible between the content generation unit 100 and the client terminal TM.

The Web server 500 acquires, for example, information identifying a user (hereinafter referred to as a customer ID) and information related to a user's attributes from a request from a client terminal TM, and transmits the information to the information processing system 1.

The information processing system 1 searches for the material information S using, for example, the information about the user's attribute received from the Web server 500, synthesizes the material information S which is the search result, and generates the content including the moving image. .. As shown in FIG. 2, the information processing system 1 searches for material information S using information on a favorite sport or school from among user attribute information, and generates content including the search result. ..

The material information S shown in FIG. 1 includes, for example, character information T and image information P. Hereinafter, a case where the material information S shown in FIG. 1 is information constituting one article such as a newspaper or a magazine will be described with reference to FIG. 2. The material information S includes at least one character information T and a part or all of the image information P corresponding to the character information T.

FIG. 2 is an example of the composition of a newspaper article on paper. The newspaper article shown in FIG. 2 has, for example, a plurality of character information T1 to T4 and a plurality of image information P1 to P3.

The text information T includes, for example, a "headline" (T1), which is the headline of the article, an "introduction sentence" (T2), which is the gist of the article information, a "text" (T3), which is the main subject of the article information, and the main subject of the article information. There is "supplementary information" (T4) that explains the whole content and some terms. Further, the image information P includes, for example, news photographs (P1, P2) and illustrations (P3) corresponding to the introductory text and the text. Further, in FIG. 2, an example of a single article on a newspaper as a paper medium is given, but for example, in the case of an article distributed on a Web page, video data or audio data can be used as the material information S. It may be included.

Further, the material information S may include information that has not actually been adopted on the paper of newspapers and magazines. Information that was not adopted on the paper is, for example, article information (summary) with a different number of characters created for the purpose of providing other than the paper, and the text of unpublished article information that was not published on the paper because it was replaced with another article. , Press photos, memos at the time of coverage that are the source of article information, video data and audio data at the time of coverage, image data owned by the material provider, and the like may be included.

Hereinafter, a configuration example of the information processing system 1 will be described with reference to FIG. FIG. 3 is a diagram showing an example of the configuration of the information processing system 1. The information processing system 1 includes, for example, a content generation unit 100, a material management unit 200, a customer management unit 300, a voice synthesis unit 400, and a Web server 500. The information processing system 1 includes at least a content generation unit 100. The information processing system 1 may or may not include a part or all of the material management unit 200, the customer management unit 300, and the voice synthesis unit 400.

When the content generation unit 100 receives the reproduction request via the Web server 500, the content generation unit 100 extracts the article information according to the user's interests / interests from the material management unit 200 based on the predetermined extraction conditions, and the moving image. To generate. The predetermined extraction conditions are, for example, customer information such as user attribute information and preference information held by the customer management unit 300, and moving image generation conditions (for example, moving image reproduction time) set by the user.

The material management unit 200 writes a time stamp, tag information, and character information T on the character information T and the image information P, which are the material information S, so that the material information S extraction process performed by the content generation unit 100 can be smoothly performed. Information such as the person in charge or the person in charge of interviewing is given and stored in the storage device. The tag information is a keyword that simply expresses the material information S. The Material Management Department 200, for example, refers to the material information S that constitutes the social aspect of the child-rearing support policy of the local council, such as "politics", which is the classification of articles, "social aspect", which is the place where articles are posted, and "local areas". The main terms of the material information S such as "parliament" and "child-rearing support policy" are set as tag information. Further, the material management unit 200 may also hold a record of the composition such as "4 pages of the morning edition of the date" as the place where the article is posted. The storage device of the material management unit 200 is composed of, for example, a database for a large amount of data.

The customer management unit 300 manages attribute moving image generation conditions, attribute information, and preference information regarding the user. The moving image generation condition is, for example, a condition in the field of an article in which information is desired to be obtained from a moving image, such as how long the playback time of the moving image is desired. For example, the user sets conditions for moving images such as "slow reading speed", "today's news including politics and sports", and "reference time is 5 [minutes]" as moving image generation conditions. The attribute information is personal information such as the user's age, gender, family structure, place of residence, place of work, place of origin, family structure, and school of origin. The preference information is, for example, a news genre that the user is highly interested in, or a keyword that simply indicates information that is particularly interesting in the news genre. The preference information may be set by the user, for example, from the options categorized by the service provider of the information processing system 1 or the operator of the Web server 500. In addition, the preference information is set by the user with arbitrary words and phrases indicating, for example, the name of the supporting political party, the policy of interest, the name of the sports team to support, the name of the athlete, the person in charge of writing the article, the person in charge of interviewing, and the like. May be good. The category setting is used as an extraction condition, for example, in the extraction process of the material information S of the material management unit 200. As the moving image generation condition, for example, there are initial settings set by the service provider of the information processing system 1 and the operator of the Web server 500, but the user decides whether or not to set the attribute information and the preference information in detail. May be arbitrarily selected by. The customer management unit 300 may be a system that holds personal information of the user, such as a CRM (Customer Relationship Management) system or a billing system, or shares the personal information of the user with a system that holds the personal information of the user. You may.

The voice synthesis unit 400 synthesizes a synthetic voice file that reads out the character information T output from the content generation unit 100. The voice synthesis unit 400 selects the reading speed, the gender of the voice, the pitch of the voice, and the like based on the user's settings managed by the customer management unit 300. Further, the voice synthesis unit 400 may select a voice suitable for reading aloud based on the tag information of the character information T. The voice suitable for reading aloud is, for example, a person appearing in the character information T, a voice reminiscent of the subject of the image information P, or a voice imitating the person. Further, when the information of the person in charge of writing or the person in charge of interviewing the character information T is set, the voice synthesis unit 400 may generate a synthetic voice file imitating the voice of the person in charge of writing or the person in charge of interviewing. .. Further, the voice synthesis unit 400 may select a suitable sound effect or BGM (Background Music) based on the tag information of the character information T and add it to the synthetic voice file.

The Web server 500 receives a reproduction request from the client terminal TM via the network NW. The reproduction request includes, for example, a customer ID of a user who uses the client terminal TM. Further, the reproduction request may include the user's moving image generation condition and attribute information. The Web server 500 distributes the moving image generated by the content generation unit 100 to the client terminal TM via the network NW, for example.

Hereinafter, an example of the functional configuration of the information processing system 1 will be described with reference to FIG. FIG. 4 is a diagram showing a functional configuration example of the information processing system 1. The components of the content generation unit 100 are realized by, for example, a hardware processor such as a CPU (Central Processing Unit) executing a program (software). In addition, some or all of these components are hardware (circuits) such as LSI (Large Scale Integration), ASIC (Application Specific Integrated Circuit), FPGA (Field-Programmable Gate Array), GPU (Graphics Processing Unit), etc. It may be realized by the part; including circuitry), or it may be realized by the cooperation of software and hardware. The program may be stored in advance in a storage device such as an HDD (Hard Disk Drive) or a flash memory, or may be stored in a removable storage medium such as a DVD (Digital Versatile Disc) or a CD-ROM for storage. The medium may be installed in the storage device by being attached to the drive device.

The content generation unit 100 includes, for example, an extraction unit 110, a material request transmission / reception unit 120, a customer identification information transmission / reception unit 130, a topic generation unit 140, a voice synthesis request transmission / reception unit 150, a moving image generation unit 160, and content transmission. A unit 170 and a storage unit 180 are provided.

The extraction unit 110 receives a reproduction request from the client terminal TM via the Web server 500. The extraction unit 110 acquires the customer ID from the received reproduction request and outputs it to the customer identification information transmission / reception unit 130.

The customer identification information transmission / reception unit 130 transmits the customer ID to the customer management unit 300. The customer identification information transmission / reception unit 130 receives, for example, the extraction result of the user's moving image generation condition, attribute information, and preference information from the customer management unit 300. The customer identification information transmission / reception unit 130 outputs the extraction result of the received moving image generation condition / attribute information / preference information of the user to the extraction unit 110.

The extraction unit 110 sets the extraction condition of the material information S based on the extraction result of the user's moving image generation condition, attribute information, and preference information output from the customer identification information transmission / reception unit 130, and the material request transmission / reception unit 120. The extraction conditions are output to.

The material request transmission / reception unit 120 transmits a material request including extraction conditions output from the extraction unit 110 to the material management unit 200. The material request transmission / reception unit 120 receives the response of the material request from the material management unit 200 and outputs the response to the extraction unit 110. The response of the material request is, for example, one or more character information T and image information P corresponding to information for identifying the material information S related to one article (hereinafter, article ID). The response to the material request may not include the image information P.

For example, the extraction unit 110 derives an estimated reproduction time from the number of characters of the character information T included in the response of the material request output from the material request transmission / reception unit 120, and makes the amount of information satisfying the moving image generation condition. Select information T. The extraction unit 110 outputs the moving image generation condition, the selected character information T, and the image information P corresponding to the same article ID as the character information T to the topic generation unit 140. It should be noted that the extraction unit 110 assumes that the material information S extracted based on the extraction condition of the material information S with priority given to the user's attribute information and preference information does not meet the guideline time of the moving image generation condition. Extraction processing to add other article information may be performed so that the total playback time and the estimated time have a predetermined relationship. The predetermined relationship is such that the error between the set guideline time and the total estimated reproduction time is within the range allowed in advance (for example, about 20 [seconds]). Further, the extraction unit 110 displays the image information P having one image information P in the shortest display time (for example, for example,) in which the number of image information P extracted based on the extraction condition of the material information S with priority given to the user's attribute information and preference information. 5 [seconds]) If the number of images is larger than the number of images that can be displayed during the assumed playback time, the image information P is selected based on, for example, the user's attribute information and preference information. do.

The topic generation unit 140 generates a structure of a moving image for each article from the character information T and the image information P output from the extraction unit 110. A topic is a unit that represents information related to one article among the elements constituting a moving image. The structure of the moving image is, for example, when there are a plurality of character information T corresponding to the same article ID, which character information T is read out in order, or when there are a plurality of image information P. It is a configuration in which image information P is displayed in order, and which image information P is configured to be displayed for how long. Further, the topic generation unit 140 publishes the material information S of the article published on the paper or the like and the material information S not posted on the paper or the like on the paper or the like when there are a plurality of image information Ps. The composition of the moving image is generated so that the material information S of the published article is reproduced first. Further, when the topic generation unit 140 has a plurality of image information P output from the extraction unit 110, the topic generation unit 140 is based on the creation timing information (for example, the time stamp of the file storing the material information S) provided in the image information P. The reproduction order of the image information P is determined. The topic generation unit 140 may determine the reproduction order of the image information P based on the order of publication on newspaper, magazine, or the like. The topic generation unit 140 outputs the moving image generation conditions and the generation result of the moving image configuration to the moving image generation unit 160.

The voice synthesis request transmission / reception unit 150 transmits a voice synthesis request output from the moving image generation unit 160, including a setting related to reading aloud among the moving image configuration, character information T, and moving image generation conditions, to the voice synthesis request unit 400. .. Further, the voice synthesis request transmission / reception unit 150 outputs the synthetic voice file received from the voice synthesis unit 400 to the moving image generation unit 160.

When a moving image is generated from a plurality of topics, the moving image generation unit 160 generates a moving image configuration so that the playback order of the moving topic moving images is suitable based on the user's attribute information and preference information. The preferred topical moving image reproduction order is, for example, to determine the reproduction order based on the priority specified in the user's moving image generation condition. Further, when the content of the moving image generation unit 160 is related to a plurality of topics (for example, in the case of a sports topic, the topic of the final is reproduced after the topic of the semi-final, or the topic of the latest game is followed by the past. The playback order of the topic video images, which is suitable for playing back the topic looking back on the game, is the order in which the time series is taken into consideration. The moving image generation unit 160 outputs a voice synthesis request including the composition of the moving image, the character information T output from the topic generation unit 140, and the setting related to reading aloud among the moving image generation conditions to the voice synthesis request transmission / reception unit 150.

The moving image generation unit 160 constitutes a moving image from the synthesized voice file output from the voice synthesis request transmission / reception unit 150 and the image information P output from the topic generation unit 140. The moving image generation unit 160 generates a moving image in which, for example, the image information P is played back in a slide show format and the synthetic audio file is played back at the same time. The moving image generation unit 160 outputs the generated moving image to the content transmission unit 170. Further, the moving image generation unit 160 outputs the configuration of the generated moving image to the storage unit 180.

The content transmission unit 170 distributes the moving image output from the moving image generation unit 160 to the client terminal TM via the Web server 500 and the network NW.

The storage unit 180 stores the generation record of the moving image generated by the moving image generation unit 160.

The material management unit 200 includes, for example, a public flag setting unit 202, a material DB 204, a material extraction unit 206, and a material management communication unit 208.

The public flag setting unit 202 performs a public flag setting process for setting a public flag in the material information S. The public flag is flag information indicating whether or not it can be used as a moving image. For example, when the material information S is newly registered, the public flag setting unit 202 performs a public flag setting process of disabling it as a moving image as an initial setting of the public flag. The material information S performs a public flag setting process for changing the public flag to a setting that can be used as a moving image, for example, when it is reviewed by a user of the information processing system 1.

The material DB 204 is, for example, a database that centrally manages the material information S. The material extraction unit 206 performs a process of extracting the material information S from the material DB 204 based on the material request output from the material management communication unit 208. The material extraction unit 206 outputs the result of extracting the material information S from the material DB 204 to the material management communication unit 208.

The material management communication unit 208 communicates with the content generation unit 100, receives a material request from the material request transmission / reception unit 120, and extracts the material information S output from the material extraction unit 206, and obtains the result of the material request transmission / reception unit 120. Is sent as a response to the material request.

The customer management unit 300 includes, for example, a setting information management unit 302, a setting information extraction unit 304, a customer DB 306, and a customer management communication unit 308.

The setting information management unit 302 manages the user's moving image generation condition, attribute information, and preference information in association with the customer ID. For example, the setting information management unit 302 instructs the customer DB 306 to store the user's moving image generation condition received from the client terminal TM as data of the moving image generation condition of the corresponding customer ID.

The setting information extraction unit 304 extracts, for example, which information is transmitted as the extraction condition used by the extraction unit 110 from the information held by the attribute information and the preference information based on the moving image generation condition of the user. The attribute information and the preference information may be set in advance by the user with a priority to be used as an extraction condition. Further, the setting information extraction unit 304 determines the degree of matching indicating how much material information S can be extracted when the material information S of the material DB 204 is searched using, for example, attribute information and preference information. The accuracy of the extraction process may be improved by determining the information to be used as the extraction condition with priority among the attribute information and the preference information.

The customer DB 306 is a database that manages a user's moving image generation condition, attribute information, and preference information in association with the customer ID. The customer management communication unit 308 communicates with the content generation unit 100 and receives a customer ID from the customer identification information transmission / reception unit 130, or the customer identification information transmission / reception unit 130 receives the user's moving image generation conditions, attribute information, and preference information. Send the extraction result.

The voice synthesis unit 400 includes, for example, a synthetic voice generation unit 402 and a voice synthesis communication unit 404.

The synthetic voice generation unit 402 generates a synthetic voice file that reads out the character information T received from the content generation unit 100. When the synthetic voice generation unit 402 also receives the setting related to the voice reading speed from the content generation unit 100, the synthetic voice generation unit 402 generates a synthetic voice file by reflecting the setting and outputs it to the voice synthesis communication unit 404. do.

The voice synthesis communication unit 404 receives the composition of the moving image and the character information T for voice synthesis from the content generation unit 100. Further, the voice synthesis communication unit 404 may receive a setting related to the reading speed of the voice together with the character information T for voice synthesis from the content generation unit 100. The voice synthesis communication unit 404 outputs the setting related to the reading speed of the voice to the synthesis voice generation unit 402 together with the character information T for voice synthesis from the received content generation unit 100. The voice synthesis communication unit 404 transmits the synthetic voice file output from the synthetic voice generation unit 402 to the content generation unit 100.

Hereinafter, an example of generating a topic, which is a component of a moving image, will be described with reference to FIG. 2 again.

When the extraction unit 110 targets an article in which two or more character information T exists in the article information as in the newspaper article shown in FIG. 2, the extraction unit 110 is based on the attribute information and preference information of the client terminal TM. The number of character information T to be extracted and the character information T to be adopted are selected. Further, the image information P corresponding to the character information T is also selected.

For example, when the article is in a category in which the user sets a high priority, the extraction unit 110 may select all the character information T1 to T4 corresponding to the article information. Further, for example, when the extraction unit 110 wants to allocate more assumed reproduction time of another topic, only the heading (T1) and the introductory sentence (T2) may be selected from the character information T.

The topic generation unit 140 calculates the reproduction time when the moving image is processed from the total number of characters of the extracted character information T from the article information input from the extraction unit 110. If there is a setting related to the reading speed of the voice, the topic generation unit 140 calculates the reproduction time when the moving image is processed in consideration of the setting. Further, the topic generation unit 140 generates a slide show format moving image so that the image information P input from the extraction unit 110 fits within the calculated reproduction time. The topic generation unit 140 switches the image information P, for example, at the timing when the character information T is switched.

For example, when the topic generation unit 140 generates a moving image from the character information T1 to T4 and the image information P1 to P3, the topic generation unit 140 displays the image information P1 while reading the character information T1 and T2, and is reading the character information T3. The image information P2 is displayed on the screen, and a moving image is generated such that P3 is displayed while the character information T4 is being read aloud.

Further, when the topic generation unit 140 generates a moving image from the character information T1 to T2 and the image information P1 to P2, for example, at an arbitrary timing during reading of the character information T1 and T2 (for example, half of the assumed reproduction time). After displaying the image information P1 until the timing when the above has elapsed), a moving image for displaying the image information P2 is generated.

If the material information S input from the extraction unit 110 is moving image data or voice data, the topic generation unit 140 excludes a part or all of the character information T from the target to be output to the voice synthesis unit 400. You may.

Further, when a plurality of character information T input from the extraction unit 110 exists, the topic generation unit 140 rearranges them in a predetermined order. The predetermined order of the character information T is the order of reproducing the publication order in the article (for example, in the case of the material information S in FIG. 2, the order of the headline (T1), the introductory sentence (T2), and the text (T3)). It is the order in which the character information T adopted as an article is arranged so as to be read out before the unadopted character information T. Similarly, when a plurality of image information Ps input from the extraction unit 110 exist, the images are rearranged in a predetermined order. The predetermined order of the image information P is the order in which the publication order in the article is reproduced, or the order in which the image information P adopted in the article is arranged so as to be read out before the unadopted image information P. Is.

Hereinafter, with reference to FIGS. 5 to 9, an example of the extraction process of the extraction unit 110 that reflects the user's attribute moving image generation conditions and preference information will be shown.

FIG. 5 is an example of a material management table provided in the material DB 204. The material management table manages, for example, the correspondence between the article and the material information S. In the material management table of FIG. 5, for example, an article having an article ID of 1-1, an image information P having a photo ID of P1-1-1, P1-1-2, and a character having a document ID of T1-1-1. It is shown that it is composed of information T. Further, the material management table of FIG. 5 shows, for example, that the public flag of the image information P whose photo ID is 2-1-4 is set so that it cannot be used as a moving image.

6 to 8 are examples of customer information provided in the customer DB 306. FIG. 6 is an example showing the moving image generation conditions. The moving image generation condition of FIG. 6 is, for example, when the content generation unit 100 generates a moving image corresponding to the user with the customer ID "1", the moving image reference time is "5 [minutes]" and the reading speed is "5 [minutes]". Indicates that it is set to "slowly". The moving image generation condition is a choice set by the service provider of the information processing system 1 or the operator of the Web server 500 (for example, in the case of reading speed, "slow", "normal", and "stop". It may be set from one option).

FIG. 7 is an example showing attribute information. The attribute information in FIG. 7 shows, for example, that the personal information of the user is held for each customer ID. Further, FIG. 8 is an example showing preference information.

The preference information in FIG. 8 shows, for example, that the preference information of the user with the customer ID "1" is held. As shown in the preference information of FIG. 8, the news field, priority, and related keywords are registered in the preference information. For example, when the material information S of the moving image includes the material information S associated with the preference information, the extraction unit 110 preferentially extracts the material information S. For example, when the preference information shown in FIG. 8 is registered, the extraction unit 110 searches for the material information S related to the words / phrases registered in the preferences 1 to 4 among the material information S of the article. Articles whose results are equal to or higher than a predetermined degree of matching (hereinafter, hit) are preferentially extracted, and when there is no material information S to be hit, articles with high priority specified by the service provider are extracted.

For example, when the preference information shown in FIG. 8 is registered, the extraction unit 110 extracts an article in which "XX party" is included in the tag information of the character information T and the image information P if the article is in the political field. .. Further, for example, when the preference information shown in FIG. 8 is registered, the extraction unit 110 extracts an article in which "baseball" is included in the tag information of the character information T and the image information P in the case of an article in the sports field. do.

Further, for example, when the preference information shown in FIG. 8 is registered, the extraction unit 110 includes information on the user's school of origin in the tag information of the character information T and the image information P in the case of an article in a regional field. Extract articles. Further, the extraction unit 110 extracts the material information S of the article of the event such as the baseball club of the user's school being defeated at the local tournament of Koshien as a moving image based on the preference information and the attribute information, for example. In this case, the material information S related to the baseball club of the user's home school is preferentially extracted instead of the material information S related to the competition school.

FIG. 9 is a diagram showing a configuration example of a moving image generated by the content generation unit 100 based on the customer information of FIGS. 6 to 8. FIG. 9 is a diagram showing a configuration example of a moving image of a user with a customer ID “1”. The content generation unit 100 generates moving images to be reproduced in the order of priority of the news field set by the user, as shown in FIG. Further, as shown in FIG. 9, the content generation unit 100 distributes the topics constituting the moving image so that the amount of information corresponds to the priority of the news field set by the user.

Hereinafter, an example of the processing flow will be described using a sequence diagram. FIG. 10 is a sequence diagram showing an example of the flow of content generation processing of the information processing system 1 of the first embodiment. Note that steps S100 and S102 are processes performed at prior timings, which are different from a series of processes. Further, step S134 is a process corresponding to post-processing of a series of processes of steps S104 to S132.

The material management unit 200 performs a public flag setting process in advance for the material information S (step S100). Further, the customer management unit 300 receives the customer information of the user in advance and manages it in a state where the category is set (step S102).

First, the user transmits a video reproduction request from the client terminal TM (step S104). Next, the Web server 500 transmits the reproduction request to the content generation unit 100 (step S106). Next, the content generation unit 100 acquires the customer ID and the moving image generation condition, which are information for identifying the customer from the reproduction request, and transmits them to the customer management unit 300 (step S108). Next, the customer management unit 300 searches for customer information using the customer ID received from the content generation unit 100 (step S110), and extracts customer information corresponding to the customer ID received based on the moving image generation condition. Then, it is transmitted to the content generation unit 100 (step S112). Next, the content generation unit 100 receives the extraction result of the customer information from the customer management unit 300 (step S114).

Next, the content generation unit 100 sets the extraction condition of the material information S based on the extraction result of the customer information received from the customer management unit 300, and transmits the material request to the material management unit 200 (step S116). Next, the material management unit 200 extracts the material information S based on the extraction condition of the material information S received from the content generation unit 100, and transmits the extraction result of the material information S to the content generation unit 100 (step). S118). Next, the content generation unit 100 receives the extraction result of the material information S from the material management unit 200 (step S120).

Next, the content generation unit 100 transmits a voice synthesis request accompanied by the character information T to the voice synthesis unit 400 (step S122). Next, the voice synthesis unit 400 generates a voice synthesis file (step S124) and transmits it to the content generation unit 100 (step S126).

Next, the content generation unit 100 generates a moving image using the material information S and the voice synthesis file, and outputs the moving image to the Web server 500 (step S128). Next, the Web server 500 distributes a moving image to the client terminal TM (step S130). Next, the client terminal TM reproduces the moving image (step S132).

The content generation unit 100 accumulates log information regarding the delivered moving image (step S134). This completes the processing of this sequence.

Note that the content generation unit 100 may generate general-purpose content that does not reflect the user's attribute information or preference information when the user's attribute information or preference information is not registered. In this case, the theme of the content may be specified by the service provider of the information processing system 1, the operator of the Web server 500, or the like.

Further, the content generation unit 100 may have a learning function for improving the extraction performance by using the extraction result of the material information S by the extraction unit 110. The extraction unit 110 collects, for example, the tag information of the extracted material information S stored in the storage unit 180, determines whether or not there is a more suitable category setting, and if there is a more suitable category setting, the extraction unit 110 determines. Adopt that.

As described above, in the information processing system 1 of the first embodiment, the content generation unit 100 that generates a moving image and the material management unit 200 that manages the material information S that is the source of the moving image in response to the reproduction request of the user. , Customer management unit 300 that manages user information of information processing system 1, audio synthesis unit 400 that synthesizes moving image composite audio files, accepts playback requests from users, and distributes content including moving images to users. With the Web server 500, it is possible to provide attractive contents according to the user's taste.

(Second embodiment)
Next, the information processing system 1A of the second embodiment will be described. In the following description, parts having the same functions as those described in the first embodiment shall be given the same names and reference numerals, and specific description of the functions will be omitted.

FIG. 11 is a diagram showing an example of the configuration of the information processing system 1A of the second embodiment. As shown in FIG. 11, the information processing system 1A of the second embodiment is different from the first embodiment in that the topic generation unit 140 of the content generation unit 100A is provided with the alternative image generation unit 142. Further, the Web server 500 is different in that it can communicate with a server that provides an SNS (Social Networking Service) (hereinafter, SNS server 900). Therefore, in the following, the communication between the content generation unit 100A and the SNS server 900 will be mainly described.

Hereinafter, the content generation unit 100A of the information processing system 1A will be described with reference to FIG. FIG. 12 is a diagram showing an example of a configuration function configuration of the information processing system 1A.

The information processing system 1A includes, for example, a content generation unit 100A, a material management unit 200, a customer management unit 300, and a voice synthesis unit 400. The topic generation unit 140 of the content generation unit 100A includes, for example, an alternative image generation unit 142.

The substitute image generation unit 142 generates a predetermined substitute image when the number of image information P extracted by the extraction unit 110 is relatively small compared to the number of images that can be displayed during the assumed reproduction time. The predetermined alternative image is, for example, a telop image in which a part or all of the character information T to be read out is converted into an image and posted, or a dedicated image in which a message indicating that there is no image is posted. The substitute image generation unit 142 outputs a predetermined substitute image to the moving image generation unit 160 in the same manner as the other material information S.

Hereinafter, the temporary setting of the moving image generation condition by the user will be described.

The user may register the moving image generation condition and the preference information in the customer management unit 300 in advance, or may temporarily set each time the reproduction request is transmitted. Hereinafter, an example of processing when the content generation unit 100A generates a moving image based on the temporary setting of the moving image generation condition by the user will be described.

When the reproduction request includes a temporary setting, the extraction unit 110 gives priority to the moving image generation condition and preference information of the temporary setting, and transmits the material request to the material request transmission / reception unit 120. Further, when the reproduction request received from the customer identification information transmission / reception unit 130 does not include the moving image generation condition and the preference information, the extraction unit 110 does not perform any extraction processing and transmits the generated general-purpose content. It may be output to the moving image generation unit 160 as described above.

Further, the temporary setting of the moving image generation condition is not only left in the storage unit 180 but also output to the customer management unit 300, for example, and the temporary setting set in the past by the user can be confirmed or reused. It may be possible to reflect it in the attribute information. Hereinafter, an example of a process in which the temporary setting of the moving image generation condition is output to the customer management unit 300 will be described.

The content generation unit 100A receives a playback request including a temporary setting from the client terminal TM via the Web server 500. The extraction unit 110 outputs the customer ID and the temporary setting to the customer identification information transmission / reception unit 130. The customer identification information transmission / reception unit 130 outputs the customer ID and temporary settings output from the extraction unit 110 to the customer management communication unit 308 of the customer management unit 300.

The customer management communication unit 308 outputs the customer ID output from the content generation unit 100A and the temporary setting to the setting information management unit 302. The setting information management unit 302 searches for information having user attribute information held by the customer DB 306 using the customer ID, and stores the contents of the temporary setting as a part of the attribute information.

Hereinafter, the post acceptance process for accepting the posting of the material information S by the user will be described. Hereinafter, an example in which image data such as a photograph is posted by a user will be described, but the posted material information S may be character information T, moving image data, or voice data.

For example, the user transmits image data that is the material information S of the moving image from the client terminal TM to the Web server 500 via the network NW. The Web server 500 transmits the image data and the customer ID of the user who posted the image data to the material management communication unit 208 of the material management unit 200 of the information processing system 1A. The image data posted by the user has a "reader-provided flag" so that the photo ID in the material management table of FIG. 5 can be distinguished from other material information S, such as the image information P of P2-1-3. It may be set. Further, the customer ID of the user who posted the image data is associated and stored in the image information P whose photo ID is P2-1-3 in the material management table.

The posting of the material information S by the user may be performed by a method specified by the service provider of the information processing system 1A (for example, a posting function provided in a dedicated application program for reproducing the content generated by the information processing system 1A). .. Further, when the user posts the material information S, the SNS account information is registered in advance as attribute information by the user, and the SNS account information is registered in advance via the contact function, the reply function, the information diffusion function, etc. provided by the operator of the SNS server 900. It may be done.

The material management communication unit 208 outputs image data to the public flag setting unit 202, causes the public flag setting unit 202 to set a public flag that cannot be used as a moving image, and registers the material ID in the image data in the material DB 204. Further, the material management communication unit 208 outputs the customer ID of the user who posted the image data and the material ID to the customer management communication unit 308 of the customer management unit 300.

The image data posted by the user, like the other material information S, is a public flag that changes the public flag to a setting that can be used as a moving image when it is reviewed by the user of the information processing system 1. The setting process is performed.

Even if the setting information management unit 302 manages, for example, the public flag of the image data posted by the user has been changed to a setting that can be used as a moving image, and the number of times the image data has been used as a moving image is managed by the customer DB 306. good. The number of times used as a moving image collected by the setting information management unit 302 is determined by, for example, customer service (for example, setting a rank according to the number of postings or converting the number of times used for a moving image into points. As an information source when performing (returning to the user), it may be used by the provider of the information processing system 1 or the operator of the Web server 500.

As described above, the information processing system 1A of the second embodiment has the same effect as the information processing system 1 of the first embodiment, and when the image information P that is the source of the moving image is small, an alternative image is used. By the alternative image generation unit 142 to be generated, it is possible to generate a moving image displaying a suitable image even if the article has a small amount of image information P.

Further, the information processing system 1A of the second embodiment allows the user to temporarily set the moving image generation condition, and accepts the posting of the image data by the user, thereby more flexibly responding to the user's preference. It is possible to generate a moving image.

According to at least one embodiment described above, the extraction unit that extracts the material information S from the group of the material information S of the article based on the setting preset by the user, and the material information S extracted by the extraction unit. Content generation that generates content including a moving image obtained by playing back the image information P included in the material information S in a predetermined order based on the creation timing information accompanying the character information T or the image information P included in the material information S. By having a department, it is possible to generate attractive content.

Further, in the above-described embodiment, the material information S of the moving image included in the content is an example of an article of a newspaper or a magazine, but for example, the reference time and the estimated playback time are adjusted to have a predetermined relationship. Therefore, the character information T and the image information P for the purpose of advertising or notification may be included in the material information S.

Further, in the above-described embodiment, the reproduction history of the content is stored in the storage unit 180, but for example, the material management unit 200 or the customer management unit 300 may be linked. The material management unit 200 may use, for example, the reproduction history of the content as a material for examining the options for setting the category. Further, for example, the customer management unit 300 analyzes the reproduction history of the content, and when some tendency is obtained in the classification such as age and occupation, the customer management unit 300 aims to improve the accuracy of the extraction process performed by the extraction unit 110. The analysis result may be reflected.

Further, in the above-described embodiment, the user selects and sets the reading speed of the voice synthesis file from the options set by the service provider of the information processing system 1 and the operator of the Web server 500. For example, it may be determined based on the attribute information of the user. For example, the voice synthesis unit 400 reads aloud at a speed corresponding to "Hayame" if the user's age is young or middle age, based on the age of the user holding the user's attribute information acquired from the customer management unit 300. If the user's age is senior, adjustments such as reading aloud at a speed corresponding to "slowly" may be made.

Since the content generated in the above-described embodiment is created based on the user's playback request, the timing of the playback request may be, for example, half a day to several days after the previous playback request, or the previous time. If the material information S is updated from the reproduction request, it is assumed that content different from the previous one is generated. On the other hand, when the timing of making the reproduction request is, for example, about 1 [time] after the previous reproduction request, or the timing when the material information S has not been updated since the previous reproduction request was made. , The same content may be created.

Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other embodiments, and various omissions, replacements, and changes can be made without departing from the gist of the invention. These embodiments and variations thereof are included in the scope of the invention described in the claims and the equivalent scope thereof, as are included in the scope and gist of the invention.

1, 1A ... Information processing system, 100, 100A ... Content generation unit, 110 ... Extraction unit, 120 ... Material request transmission / reception unit, 140 ... Topic generation unit, 142 ... Alternative image generation unit, 160 ... Dynamic image generation unit, 170 ... Content transmission unit, 200 ... Material management department, 300 ... Customer management department, 400 ... Voice synthesis department, 500 ... Web server, 900 ... SNS server, TM ... Client terminal

Claims (11)

An extraction unit that extracts at least one material information from a group of material information of an article that includes at least character information and may include image information based on predetermined extraction conditions.
The image information included in the material information of the article including the image information among the material information based on the character information included in the material information extracted by the extraction unit or the creation timing information accompanying the image information. A content generation unit that generates content including moving images obtained by playing back images in a predetermined order.
The predetermined extraction condition includes at least user preference information.
A customer management unit that manages the predetermined extraction conditions for each user, collects tag information indicating the characteristics of the material information used in the moving image reproduced by the user, and reflects the tag information in the preference information. Further equipped with a customer management department
Information processing system. Further provided with a material management unit that manages the material information and accepts the setting of a public flag that indicates whether or not the character information and the image information can be used as the moving image.
The extraction unit extracts the material information for which the public flag set by the material management unit is set to be usable as the moving image.
The information processing system according to claim 1. Further equipped with a voice synthesis unit that converts the character information into a synthetic voice file,
The content generation unit generates the content in which the synthetic voice file is read aloud.
The information processing system according to claim 1 or 2. Further provided with a material management unit that manages the material information and accepts the setting of a public flag that indicates whether or not the character information and the image information can be used as the moving image.
The extraction unit targets the material information for which the public flag is set by the material management unit.
The information processing system according to any one of claims 1 to 3. The predetermined extraction condition further includes a moving image generation condition preset by the user.
The moving image generation condition includes at least a reference time for the moving image.
The extraction unit
Based on the moving image generation condition, the character information is extracted, and the assumed reproduction time of the moving image is derived from the extracted character information.
The content generation unit
The moving image having a predetermined relationship with the estimated playback time is generated.
The information processing system according to any one of claims 1 to 4. The predetermined extraction condition further includes a moving image generation condition preset by the user.
The voice synthesis unit determines the speed at which the character information is read aloud based on the moving image generation condition.
The information processing system according to claim 3. The voice synthesizer
Based on the information about the person in charge of writing the character information, the synthetic voice file that imitates the voice of the person in charge of writing is generated.
The information processing system according to claim 3 or 6. The predetermined extraction condition further includes a moving image generation condition preset by the user.
The extraction unit
When the image information that matches the moving image generation condition does not exist, or when the number of the image information constituting the article is relatively small with respect to the number of characters of the character information, a predetermined alternative image is generated. , Further equipped with an alternative image generator,
The information processing system according to any one of claims 1 to 7. The predetermined extraction condition further includes attribute information including personal information of the user.
Further provided with a material management unit that manages the material information and accepts the setting of a public flag that indicates whether or not the character information and the image information can be used as the moving image.
The material management department
When the posting of the image information is received from the client terminal used by the user and the posted image information is used for the moving image, the number of times the image information is used is reflected in the attribute information.
The information processing system according to any one of claims 1 to 8. The computer
Based on a predetermined extraction condition, at least one said material information is extracted from a group of material information of an article containing at least character information and may include image information.
Based on the character information included in the extracted material information or the creation timing information accompanying the image information, the image information included in the material information of the article including the image information among the material information is arranged in a predetermined order. Generate content including moving images obtained by playing with
The predetermined extraction condition includes at least user preference information.
It manages the predetermined extraction conditions for each user and manages them.
Tag information indicating the characteristics of the material information used in the moving image reproduced by the user is collected and reflected in the preference information.
Information processing method. On the computer
Based on a predetermined extraction condition, at least one said material information is extracted from a group of material information of an article containing at least character information and may include image information.
A moving image obtained by reproducing the image information included in the material information in a predetermined order based on the character information included in the extracted material information or the creation timing information accompanying the image information is included. Generate content,
The predetermined extraction condition includes at least user preference information.
Let the user manage the predetermined extraction conditions,
The tag information indicating the characteristics of the material information used in the moving image reproduced by the user is collected and reflected in the preference information.
program.

Images