WO2018209845A1 - Method and apparatus for generating stories on the basis of picture content - Google Patents

Method and apparatus for generating stories on the basis of picture content Download PDF

Info

Publication number
WO2018209845A1
WO2018209845A1 PCT/CN2017/100329 CN2017100329W WO2018209845A1 WO 2018209845 A1 WO2018209845 A1 WO 2018209845A1 CN 2017100329 W CN2017100329 W CN 2017100329W WO 2018209845 A1 WO2018209845 A1 WO 2018209845A1
Authority
WO
WIPO (PCT)
Prior art keywords
word
story
keyword
sentence
generate
Prior art date
Application number
PCT/CN2017/100329
Other languages
French (fr)
Chinese (zh)
Inventor
张学华
刘宇翔
雷超然
季雨晴
Original Assignee
北京金山安全软件有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京金山安全软件有限公司 filed Critical 北京金山安全软件有限公司
Publication of WO2018209845A1 publication Critical patent/WO2018209845A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/5866Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information

Definitions

  • the present invention relates to the field of picture recognition technologies, and in particular, to a method and apparatus for generating a story based on picture content.
  • Artificial Intelligence abbreviated as AI in English. It is a new technical science that studies and develops theories, methods, techniques, and applications for simulating, extending, and extending human intelligence. Artificial intelligence is a branch of computer science that attempts to understand the essence of intelligence and produce a new kind of intelligent machine that can react in a way similar to human intelligence. Research in this field includes robotics, speech recognition, image recognition, Natural language processing and expert systems.
  • the recognition of a picture is only to obtain the content information of the picture, which is relatively simple, and cannot apply the picture recognition to the artificial intelligence.
  • the object of the present invention is to solve at least one of the technical problems in the related art to some extent.
  • an object of the present invention is to provide a method for generating a story based on a picture content, which is used to solve the problem that the image recognition cannot be applied to the artificial intelligence in the prior art, by further performing the recognized image content. After the generalization process, the story corresponding to the picture is generated and played, which improves the convenience and interest of the artificial intelligence and improves the user experience.
  • a second object of the present invention is to provide a story generating device based on picture content.
  • a third object of the present invention is to propose a computer device.
  • a fourth object of the present invention is to provide a non-transitory computer readable storage medium.
  • a fifth object of the present invention is to provide a computer program product.
  • a first aspect of the present invention provides a method for generating a story based on a picture content, including: identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; and according to a pre-trained story
  • the sentence-related information base generates a sentence related to the keyword and the generalized word; sorting the sentence according to a preset logic rule to generate a story corresponding to the picture and playing the same.
  • a method for generating a story based on a picture content extracting a keyword by recognizing a picture content, and acquiring a generalized word related to the keyword, and then generating a sentence related to the keyword and the generalized word according to the pre-trained story-word-related information base, and finally sorting the sentence according to the preset logical rule to generate a story corresponding to the image and The playback is performed, and the recognized picture content is further generalized to generate a story corresponding to the picture and played, thereby improving the convenience and interest of the artificial intelligence and improving the user experience.
  • the picture content-based story generation method of the embodiment of the present invention further has the following additional technical features:
  • the obtaining the generalized word related to the keyword includes: querying a preset synonym database to obtain a synonym corresponding to the keyword, and querying the pre-trained related vocabulary to obtain the keyword Corresponding related words.
  • the method further includes: performing word segmentation processing on the information content in the sample set to generate a plurality of word units; and generating a related term database according to the co-occurrence number between the word units and the preset threshold.
  • the method further includes: performing word segmentation and sentence segment processing on the information content in the story sample to generate a plurality of word units and sentence units; and according to the number of co-occurrences between the word unit and the sentence unit and the preset threshold Generating the story information related information library.
  • the method before the step of sorting the sentence according to the preset logic rule to generate a story corresponding to the image and playing the file, the method further includes: acquiring a first weight corresponding to the keyword and Determining a second weight corresponding to the generalized word; and filtering the related sentence according to the first weight and the second weight.
  • the second aspect of the present invention provides a story generating device based on a picture content, comprising: an extracting module, configured to identify a picture content extraction keyword; and a first acquiring module, configured to acquire the key a word-related generalization word; a first generation module, configured to generate a sentence related to the keyword and the generalization word according to a pre-trained story-word association information library; and a processing module, configured to use a preset logic rule The sentence is sorted to generate a story corresponding to the picture and played.
  • the picture content-based story generating apparatus extracts keywords by recognizing the picture content, acquires generalized words related to the keywords, and then generates keywords and generalized words according to the pre-trained story-word-related information base.
  • the sentence is sorted according to the preset logic rule to generate a story corresponding to the picture and played, so that the recognized picture content is further generalized to generate a story corresponding to the picture and played.
  • the picture content-based story generating apparatus of the embodiment of the present invention further has the following additional technical features:
  • the obtaining module is configured to: query a preset synonym database to obtain a synonym corresponding to the keyword, and query a pre-trained related vocabulary to acquire an associated word corresponding to the keyword.
  • the obtaining module is further configured to: perform word segmentation processing on the information content in the sample set to generate a plurality of word units; and generate a related term database according to the co-occurrence number between the word units and the preset threshold.
  • the device further includes: a second generating module, configured to perform word cutting and sentence processing on the information content in the story sample to generate a plurality of word units and sentence units; and a third generating module, configured to use the words according to the words Co-occurrence between unit and sentence unit The number of times and the preset threshold generate the library of related information of the story words.
  • a second generating module configured to perform word cutting and sentence processing on the information content in the story sample to generate a plurality of word units and sentence units
  • a third generating module configured to use the words according to the words Co-occurrence between unit and sentence unit The number of times and the preset threshold generate the library of related information of the story words.
  • the device further includes: a second acquiring module, configured to acquire a first weight corresponding to the keyword and a second weight corresponding to the generalized word; and a screening module, configured to The first weight and the second weight filter the related sentences.
  • a second acquiring module configured to acquire a first weight corresponding to the keyword and a second weight corresponding to the generalized word
  • a screening module configured to The first weight and the second weight filter the related sentences.
  • a third aspect of the present invention provides a computer device comprising: a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor When the program is executed, enabling a story content generation method based on picture content, the method comprising: identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; and correlating according to a pre-trained story phrase
  • the information base generates a sentence related to the keyword and the generalized word; sorting the sentence according to a preset logic rule to generate a story corresponding to the picture and playing the same.
  • a fourth aspect of the present invention provides a non-transitory computer readable storage medium capable of executing a story based on picture content when an instruction in the storage medium is executed by a processor a generating method, the method comprising: identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; generating, according to the pre-trained story word association information library, the keyword and the generalization word a sentence; sorting the sentence according to a preset logic rule to generate a story corresponding to the picture and playing the same.
  • a fifth aspect of the present invention provides a computer program product, when executed by an instruction processor in the computer program product, a method for generating a story based on a picture content, the method comprising: Identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; generating a sentence related to the keyword and the generalization word according to a pre-trained story word association information base; according to a preset logic rule The sentence is sorted to generate a story corresponding to the picture and played.
  • FIG. 1 is a flowchart of a method for generating a story based on a picture content according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of a sample of a picture according to an embodiment of the present invention.
  • FIG. 3 is a schematic diagram of generating a story based on picture content according to another embodiment of the present invention.
  • FIG. 4 is a flowchart of a method for generating a story based on a picture content according to another embodiment of the present invention.
  • FIG. 5 is a schematic structural diagram of a story content generating apparatus based on a picture content according to an embodiment of the present invention
  • FIG. 6 is a schematic structural diagram of a story content generating apparatus based on a picture content according to another embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of a story content generating apparatus based on a picture content according to another embodiment of the present invention.
  • FIG. 1 is a flowchart of a method for generating a story based on a picture content according to an embodiment of the present invention.
  • picture content-based story generation method in the embodiment of the present application can be applied to devices (mobile phones, tablets, computers, etc.) of Android, IOS, PC, and the like.
  • the picture content recognition refers to interpreting the picture, and can identify an object included in the picture, a shooting scene of the picture, and the like.
  • the image content recognition method is object detection, that is, by defining a series of templates, each template captures a certain type of object.
  • the present invention provides a story generation method based on picture content, and further generalizes the recognized picture content to generate a story corresponding to the picture and play it. details as follows:
  • the image content-based story generation method includes the following steps:
  • Step 101 Identify a picture content extraction keyword.
  • Step 102 Obtain a generalized word related to the keyword.
  • the picture may be processed by a picture recognition software or an algorithm to identify the picture content, and the picture content is processed to extract keywords. It can be understood that a number of words or phrases representing picture content are extracted as keywords.
  • the generalized word related to the keyword can be obtained in a plurality of ways.
  • the predetermined synonym database is used to obtain a synonym corresponding to the keyword, and the pre-trained related vocabulary is obtained by querying the corresponding vocabulary. Related words.
  • the keywords are “girl”, “woman”, etc., and then querying the synonyms of “girl”, “woman”, etc. in the preset synonym database, for example. “Girls”, “Goddess”, “Beautiful People”, etc., and then query the pre-trained related vocabulary. For example, “girls” correspond to “cute” and “meng Meng”, so that “Goddess” and “Girls” can be obtained.
  • Synonyms and related words such as “model”, “beauty”, “cute”, “beautiful”, “beautiful”, “beauty”, “meng Meng” are used as generalization words related to keywords.
  • the thesaurus is pre-set, such as "beauty” and “girl” are synonymous words; “severe”, “great” is a synonym, etc., and the lexicon can be adjusted as needed to increase or decrease the number of synonyms.
  • the synonym database holds the relationship of multiple synonyms (the form can be a mapping table, etc.), for example, by keyword X. Find the corresponding mapping table (which can also be calculated by related algorithms, etc.) to find the synonym Y, Z, or more synonyms.
  • the related vocabulary can be trained in a plurality of ways.
  • the information content in the sample set is subjected to word-cutting processing to generate a plurality of word units, according to the number of co-occurrences between the word units and a preset threshold.
  • Generate a related term library That is, the correlation between a large number of word units can be evaluated. For example, if the number of occurrences of two word units together is greater than a preset threshold, for example, 10 times, the two word units are set as related words and stored in the associated thesaurus.
  • Step 103 Generate a sentence related to the keyword and the generalized word according to the pre-trained story-word-related information base.
  • Step 104 Sort the sentence according to a preset logic rule to generate a story corresponding to the picture and play it.
  • the information content in the story sample is subjected to word-cutting and sentence-breaking processing to generate a plurality of word units and sentence units; and the story-word-related information base is generated according to the number of co-occurrences between the word unit and the sentence unit and the preset threshold. That is, the relationship between the word unit and the sentence unit can be determined by the information content in a large number of story samples. For example, if a word unit and a sentence unit appear together more than a preset threshold, for example, 10 times, the word unit and the sentence unit are Saved in the story-related information library.
  • the threshold is preset so as to be stored in the story-related information base as the story-related information.
  • the sentence related to the keyword and the generalized word is generated according to the pre-trained story-word-related information base, that is, the related sentence that can be obtained through the keyword, the generalized word, and the pre-trained story-word-related information base is associated. Create a whole new story.
  • the story is continuous, that is, has a certain plot. It can be understood that there are many related sentences, and it is necessary to sort and process a plurality of sentences through a preset logic rule to generate a story corresponding to the image and play it.
  • the user uploads a picture as shown in Figure 3. It can automatically match the story corresponding to the generated picture. "In the past, there was a very beautiful little girl. She was very funny, she also had a beautiful hair. She loves the sun, she is a very cheerful person, everyone likes her, why do everyone like her? Just because people like people who love to laugh, you have to smile more.” Thereby, the interest of artificial intelligence is further improved.
  • the method for generating a story based on a picture content extracts a keyword by recognizing a picture content, acquires a generalization word related to the keyword, and then generates and keys according to the pre-trained story phrase association information base.
  • the words related to the generalized words are finally sorted according to the preset logic rules to generate a story corresponding to the picture and played, so that the recognized picture content is further generalized and then generated corresponding to the picture.
  • the story goes hand in hand Line playback improves the convenience and fun of artificial intelligence and enhances the user experience.
  • FIG. 4 is a flowchart of a method for generating a story based on a picture content according to another embodiment of the present invention. As shown in FIG. 4, before step 104, the method further includes:
  • Step 201 Acquire a first weight corresponding to the keyword and a second weight corresponding to the generalized word.
  • Step 202 Filter related sentences according to the first weight and the second weight.
  • the user may give different weights to the keyword and the generalized word according to actual application requirements, for example, the first weight corresponding to the keyword is 0.4; the second weight corresponding to the generalized word is 0.6.
  • the first weight corresponding to the keyword is 0.4
  • the second weight corresponding to the generalized word is 0.6.
  • the present invention proposes a story generating device based on picture content.
  • FIG. 5 is a flowchart of a picture content based story generating apparatus according to an embodiment of the present invention.
  • the picture content-based story generating apparatus includes an extracting module 11, a first obtaining module 12, a first generating module 13, and a processing module 14.
  • the extraction module 11 is configured to identify a picture content extraction keyword.
  • the first obtaining module 12 is configured to obtain a generalized word related to the keyword.
  • the first generating module 13 is configured to generate a sentence related to the keyword and the generalized word according to the pre-trained story-word-related information base.
  • the processing module 14 is configured to perform a sorting process on the sentence according to a preset logic rule to generate a story corresponding to the picture and play the same.
  • the obtaining module 12 is configured to query a preset synonym database to obtain a synonym corresponding to the keyword, and query the pre-trained related vocabulary to acquire an associated word corresponding to the keyword.
  • the obtaining module 12 is further configured to perform word segmentation processing on the information content in the sample set to generate a plurality of word units; and generate a related term database according to the co-occurrence number between the word units and the preset threshold.
  • the picture content-based story generating apparatus further includes: a second generating module 15, a third generating module 16, a second obtaining module 17, and a screening module 18.
  • the second generation module 15 is configured to perform word segmentation and sentence segment processing on the information content in the story sample to generate a plurality of word units and sentence units.
  • the third generation module 16 is configured to generate a story-word association information base according to the number of co-occurrences between the word unit and the sentence unit and the preset threshold.
  • the second obtaining module 17 is configured to acquire a first weight corresponding to the keyword and a second weight corresponding to the generalized word.
  • the screening module 18 is configured to filter related sentences according to the first weight and the second weight.
  • the picture content-based story generating apparatus of the embodiment of the present invention extracts keywords by recognizing the picture content, acquires generalized words related to the keywords, and then generates and keys according to the pre-trained story words and related information bases.
  • the words related to the generalized words are finally sorted according to the preset logic rules to generate a story corresponding to the picture and played, so that the recognized picture content is further generalized and then generated corresponding to the picture.
  • the story is played and played, which improves the convenience and fun of artificial intelligence and enhances the user experience.
  • FIG. 7 is a flowchart of a picture content-based story generating apparatus according to still another embodiment of the present invention. As shown in FIG. 7, the picture content-based story generating device includes:
  • the processor 22 executes the program to implement the picture content based story generation method provided in the above embodiment.
  • the story content generating device based on the image content further includes:
  • Communication interface 23 is used for communication between memory 21 and processor 22.
  • the memory 21 is for storing a computer program executable on the processor 22.
  • the memory 21 may include a high speed RAM memory and may also include a non-volatile memory such as at least one disk memory.
  • the processor 22 is configured to implement the picture content-based story generation method described in the foregoing embodiment when the program is executed.
  • the bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. Wait.
  • ISA Industry Standard Architecture
  • PCI Peripheral Component
  • EISA Extended Industry Standard Architecture
  • the bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 7, but it does not mean that there is only one bus or one type of bus.
  • the memory 21, the processor 22, and the communication interface 23 are integrated on one chip, the memory 21, the processor 22, and the communication interface 23 can complete communication with each other through the internal interface.
  • the processor 22 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more configured to implement the embodiments of the present invention. integrated circuit.
  • CPU central processing unit
  • ASIC application specific integrated circuit
  • the present invention also provides a computer device, comprising: a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the program ⁇ / RTI> enabling a story content generation method based on picture content, the method comprising: identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; generating and keywords according to the pre-trained story word association information base A sentence related to a generalized word; sorting the sentence according to a preset logical rule to generate a story corresponding to the picture and playing it.
  • the present invention also provides a non-transitory computer readable storage medium, enabling execution of a story content generation method based on picture content when instructions in the storage medium are executed by a processor
  • the method includes: identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; generating a sentence related to the keyword and the generalization word according to the pre-trained story word association information base; and the sentence according to the preset logic rule Sorting is performed to generate a story corresponding to the picture and play it.
  • the present invention also provides a computer program product, which, when executed by an instruction processor in the computer program product, enables execution of a picture content based story generation method, the method comprising: identifying a picture Content extraction keywords; obtaining generalization words related to keywords; generating sentences related to keywords and generalization words according to pre-trained story-word association information base; sorting processing sentences according to preset logic rules to generate images Corresponding stories are played and played.
  • first and second are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated.
  • features defining “first” or “second” may include at least one of the features, either explicitly or implicitly.
  • the meaning of "a plurality” is at least two, such as two, three, etc., unless specifically defined otherwise.
  • a "computer-readable medium” can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device.
  • Computer More specific examples (non-exhaustive list) of readable media include the following: electrical connections (electronic devices) with one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), only Read memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM).
  • the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
  • portions of the invention may be implemented in hardware, software, firmware or a combination thereof.
  • multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system.
  • a suitable instruction execution system For example, if implemented in hardware and in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: discrete with logic gates for implementing logic functions on data signals Logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), and the like.
  • each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module.
  • the above integrated modules can be implemented in the form of hardware or in the form of software functional modules.
  • the integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.
  • the above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Library & Information Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

A method and apparatus for generating stories on the basis of picture content, said method comprising: identifying picture content and extracting a keyword (101); obtaining a generalized word which is related to the keyword (102); generating sentences which are related to the keyword and the generalized word according to a pre-trained a story word and sentence correlation information base (103); sorting the sentences according to a preset logic rule in order to generate a story corresponding to the picture, and playing back the story (104). Hence, a story corresponding to a picture is generated and played back after further generalization processing is carried out on identified picture content, thus increasing the convenience of artificial intelligence and making artificial intelligence more interesting, while improving user experience.

Description

基于图片内容的故事生成方法和装置Story generation method and device based on picture content
相关申请的交叉引用Cross-reference to related applications
本申请要求北京金山安全软件有限公司于2017年05月19日提交的、发明名称为“基于图片内容的故事生成方法和装置”的、中国专利申请号“201710359135.0”的优先权。The present application claims the priority of the Chinese patent application No. "201710359135.0" filed on May 19, 2017 by Beijing Jinshan Security Software Co., Ltd., entitled "Method and Apparatus for Generating Story Based on Picture Content".
技术领域Technical field
本发明涉及图片识别技术领域,尤其涉及一种基于图片内容的故事生成方法和装置。The present invention relates to the field of picture recognition technologies, and in particular, to a method and apparatus for generating a story based on picture content.
背景技术Background technique
人工智能(Artificial Intelligence),英文缩写为AI。它是研究、开发用于模拟、延伸和扩展人的智能的理论、方法、技术及应用系统的一门新的技术科学。人工智能是计算机科学的一个分支,它企图了解智能的实质,并生产出一种新的能以人类智能相似的方式做出反应的智能机器,该领域的研究包括机器人、语音识别、图像识别、自然语言处理和专家系统等。Artificial Intelligence, abbreviated as AI in English. It is a new technical science that studies and develops theories, methods, techniques, and applications for simulating, extending, and extending human intelligence. Artificial intelligence is a branch of computer science that attempts to understand the essence of intelligence and produce a new kind of intelligent machine that can react in a way similar to human intelligence. Research in this field includes robotics, speech recognition, image recognition, Natural language processing and expert systems.
目前,图片的识别仅仅在于获取图片的内容信息,比较单一,并不能够将图片识别应用到人工智能中。At present, the recognition of a picture is only to obtain the content information of the picture, which is relatively simple, and cannot apply the picture recognition to the artificial intelligence.
发明内容Summary of the invention
本发明的目的旨在至少在一定程度上解决相关技术中的技术问题之一。The object of the present invention is to solve at least one of the technical problems in the related art to some extent.
为此,本发明的一个目的在于提出一种基于图片内容的故事生成方法,用于解决现有技术中不能够将图片识别应用到人工智能中的问题,通过将识别后的图片内容进行进一步的泛化处理后生成与图片对应的故事并进行播放,提高了人工智能的便利性和趣味性,提升了用户体验。Therefore, an object of the present invention is to provide a method for generating a story based on a picture content, which is used to solve the problem that the image recognition cannot be applied to the artificial intelligence in the prior art, by further performing the recognized image content. After the generalization process, the story corresponding to the picture is generated and played, which improves the convenience and interest of the artificial intelligence and improves the user experience.
本发明的第二个目的在于提出一种基于图片内容的故事生成装置。A second object of the present invention is to provide a story generating device based on picture content.
本发明的第三个目的在于提出一种计算机设备。A third object of the present invention is to propose a computer device.
本发明的第四个目的在于提出一种非临时性计算机可读存储介质。A fourth object of the present invention is to provide a non-transitory computer readable storage medium.
本发明的第五个目的在于提出一种计算机程序产品。A fifth object of the present invention is to provide a computer program product.
为达上述目的,本发明第一方面实施例提出了一种基于图片内容的故事生成方法,包括:识别图片内容提取关键词;获取与所述关键词相关的泛化词;根据预先训练的故事词句关联信息库生成与所述关键词和所述泛化词相关的句子;根据预设的逻辑规则对所述句子进行排序处理生成与所述图片对应的故事并进行播放。In order to achieve the above object, a first aspect of the present invention provides a method for generating a story based on a picture content, including: identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; and according to a pre-trained story The sentence-related information base generates a sentence related to the keyword and the generalized word; sorting the sentence according to a preset logic rule to generate a story corresponding to the picture and playing the same.
本发明实施例的基于图片内容的故事生成方法,通过识别图片内容提取关键词,并获取 与关键词相关的泛化词,然后根据预先训练的故事词句关联信息库生成与关键词和泛化词相关的句子,最后根据预设的逻辑规则对句子进行排序处理生成与图片对应的故事并进行播放,实现将识别后的图片内容进行进一步的泛化处理后生成与图片对应的故事并进行播放,提高了人工智能的便利性和趣味性,提升了用户体验。A method for generating a story based on a picture content according to an embodiment of the present invention, extracting a keyword by recognizing a picture content, and acquiring a generalized word related to the keyword, and then generating a sentence related to the keyword and the generalized word according to the pre-trained story-word-related information base, and finally sorting the sentence according to the preset logical rule to generate a story corresponding to the image and The playback is performed, and the recognized picture content is further generalized to generate a story corresponding to the picture and played, thereby improving the convenience and interest of the artificial intelligence and improving the user experience.
另外,本发明实施例的基于图片内容的故事生成方法,还具有如下附加的技术特征:In addition, the picture content-based story generation method of the embodiment of the present invention further has the following additional technical features:
可选地,所述获取与所述关键词相关的泛化词,包括:查询预设的近义词库获取与所述关键词对应的近义词,以及查询预先训练的关联词库获取与所述关键词对应的关联词。Optionally, the obtaining the generalized word related to the keyword includes: querying a preset synonym database to obtain a synonym corresponding to the keyword, and querying the pre-trained related vocabulary to obtain the keyword Corresponding related words.
可选地,所述的方法,还包括:对样本集合中的信息内容进行切词处理生成多个词单元;根据词单元之间的共现次数和预设阈值生成关联词库。Optionally, the method further includes: performing word segmentation processing on the information content in the sample set to generate a plurality of word units; and generating a related term database according to the co-occurrence number between the word units and the preset threshold.
可选地,所述的方法,还包括:对故事样本中的信息内容进行切词和断句处理生成多个词单元和句单元;根据词单元和句单元之间的共现次数和预设阈值生成所述故事词句关联信息库。Optionally, the method further includes: performing word segmentation and sentence segment processing on the information content in the story sample to generate a plurality of word units and sentence units; and according to the number of co-occurrences between the word unit and the sentence unit and the preset threshold Generating the story information related information library.
可选地,在所述根据预设的逻辑规则对所述句子进行排序处理生成与所述图片对应的故事并进行播放之前,还包括:获取与所述关键词对应的第一权重以及与所述泛化词对应的第二权重;根据所述第一权重与所述第二权重对所述相关的句子进行筛选。Optionally, before the step of sorting the sentence according to the preset logic rule to generate a story corresponding to the image and playing the file, the method further includes: acquiring a first weight corresponding to the keyword and Determining a second weight corresponding to the generalized word; and filtering the related sentence according to the first weight and the second weight.
为达上述目的,本发明第二方面实施例提出了一种基于图片内容的故事生成装置,包括:提取模块,用于识别图片内容提取关键词;第一获取模块,用于获取与所述关键词相关的泛化词;第一生成模块,用于根据预先训练的故事词句关联信息库生成与所述关键词和所述泛化词相关的句子;处理模块,用于根据预设的逻辑规则对所述句子进行排序处理生成与所述图片对应的故事并进行播放。In order to achieve the above objective, the second aspect of the present invention provides a story generating device based on a picture content, comprising: an extracting module, configured to identify a picture content extraction keyword; and a first acquiring module, configured to acquire the key a word-related generalization word; a first generation module, configured to generate a sentence related to the keyword and the generalization word according to a pre-trained story-word association information library; and a processing module, configured to use a preset logic rule The sentence is sorted to generate a story corresponding to the picture and played.
本发明实施例的基于图片内容的故事生成装置,通过识别图片内容提取关键词,并获取与关键词相关的泛化词,然后根据预先训练的故事词句关联信息库生成与关键词和泛化词相关的句子,最后根据预设的逻辑规则对句子进行排序处理生成与图片对应的故事并进行播放,实现将识别后的图片内容进行进一步的泛化处理后生成与图片对应的故事并进行播放,提高了人工智能的便利性和趣味性,提升了用户体验。The picture content-based story generating apparatus according to the embodiment of the present invention extracts keywords by recognizing the picture content, acquires generalized words related to the keywords, and then generates keywords and generalized words according to the pre-trained story-word-related information base. In the related sentence, the sentence is sorted according to the preset logic rule to generate a story corresponding to the picture and played, so that the recognized picture content is further generalized to generate a story corresponding to the picture and played. Improve the convenience and fun of artificial intelligence and enhance the user experience.
另外,本发明实施例的基于图片内容的故事生成装置,还具有如下附加的技术特征:In addition, the picture content-based story generating apparatus of the embodiment of the present invention further has the following additional technical features:
可选地,所述获取模块用于:查询预设的近义词库获取与所述关键词对应的近义词,以及查询预先训练的关联词库获取与所述关键词对应的关联词。Optionally, the obtaining module is configured to: query a preset synonym database to obtain a synonym corresponding to the keyword, and query a pre-trained related vocabulary to acquire an associated word corresponding to the keyword.
可选地,所述获取模块还用于:对样本集合中的信息内容进行切词处理生成多个词单元;根据词单元之间的共现次数和预设阈值生成关联词库。Optionally, the obtaining module is further configured to: perform word segmentation processing on the information content in the sample set to generate a plurality of word units; and generate a related term database according to the co-occurrence number between the word units and the preset threshold.
可选地,所述的装置,还包括:第二生成模块,用于对故事样本中的信息内容进行切词和断句处理生成多个词单元和句单元;第三生成模块,用于根据词单元和句单元之间的共现 次数和预设阈值生成所述故事词句关联信息库。Optionally, the device further includes: a second generating module, configured to perform word cutting and sentence processing on the information content in the story sample to generate a plurality of word units and sentence units; and a third generating module, configured to use the words according to the words Co-occurrence between unit and sentence unit The number of times and the preset threshold generate the library of related information of the story words.
可选地,所述的装置,还包括:第二获取模块,用于获取与所述关键词对应的第一权重以及与所述泛化词对应的第二权重;筛选模块,用于根据所述第一权重与所述第二权重对所述相关的句子进行筛选。Optionally, the device further includes: a second acquiring module, configured to acquire a first weight corresponding to the keyword and a second weight corresponding to the generalized word; and a screening module, configured to The first weight and the second weight filter the related sentences.
为达上述目的,本发明第三方面实施例提出了一种计算机设备,包括:包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时,使得能够执行一种基于图片内容的故事生成方法,所述方法包括:识别图片内容提取关键词;获取与所述关键词相关的泛化词;根据预先训练的故事词句关联信息库生成与所述关键词和所述泛化词相关的句子;根据预设的逻辑规则对所述句子进行排序处理生成与所述图片对应的故事并进行播放。In order to achieve the above object, a third aspect of the present invention provides a computer device comprising: a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor When the program is executed, enabling a story content generation method based on picture content, the method comprising: identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; and correlating according to a pre-trained story phrase The information base generates a sentence related to the keyword and the generalized word; sorting the sentence according to a preset logic rule to generate a story corresponding to the picture and playing the same.
为了实现上述目的,本发明第四方面实施例提出了一种非临时性计算机可读存储介质,当所述存储介质中的指令由处理器被执行时,使得能够执行一种基于图片内容的故事生成方法,所述方法包括:识别图片内容提取关键词;获取与所述关键词相关的泛化词;根据预先训练的故事词句关联信息库生成与所述关键词和所述泛化词相关的句子;根据预设的逻辑规则对所述句子进行排序处理生成与所述图片对应的故事并进行播放。In order to achieve the above object, a fourth aspect of the present invention provides a non-transitory computer readable storage medium capable of executing a story based on picture content when an instruction in the storage medium is executed by a processor a generating method, the method comprising: identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; generating, according to the pre-trained story word association information library, the keyword and the generalization word a sentence; sorting the sentence according to a preset logic rule to generate a story corresponding to the picture and playing the same.
为了实现上述目的,本发明第五方面实施例提出了一种计算机程序产品,当所述计算机程序产品中的指令处理器执行时,执行一种基于图片内容的故事生成方法,所述方法包括:识别图片内容提取关键词;获取与所述关键词相关的泛化词;根据预先训练的故事词句关联信息库生成与所述关键词和所述泛化词相关的句子;根据预设的逻辑规则对所述句子进行排序处理生成与所述图片对应的故事并进行播放。In order to achieve the above object, a fifth aspect of the present invention provides a computer program product, when executed by an instruction processor in the computer program product, a method for generating a story based on a picture content, the method comprising: Identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; generating a sentence related to the keyword and the generalization word according to a pre-trained story word association information base; according to a preset logic rule The sentence is sorted to generate a story corresponding to the picture and played.
本发明附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本申请的实践了解到。The additional aspects and advantages of the invention will be set forth in part in the description which follows.
附图说明DRAWINGS
图1是根据本发明一个实施例提供的基于图片内容的故事生成方法的流程图;1 is a flowchart of a method for generating a story based on a picture content according to an embodiment of the present invention;
图2是是根据本发明一个实施例提供的图片样本示意图;2 is a schematic diagram of a sample of a picture according to an embodiment of the present invention;
图3是是根据本发明另一个实施例提供的基于图片内容的故事生成示意图;FIG. 3 is a schematic diagram of generating a story based on picture content according to another embodiment of the present invention; FIG.
图4是根据本发明另一个实施例提供的基于图片内容的故事生成方法的流程图;FIG. 4 is a flowchart of a method for generating a story based on a picture content according to another embodiment of the present invention; FIG.
图5是根据本发明一个实施例提供的基于图片内容的故事生成装置的结构示意图;FIG. 5 is a schematic structural diagram of a story content generating apparatus based on a picture content according to an embodiment of the present invention; FIG.
图6是根据本发明另一个实施例提供的基于图片内容的故事生成装置的结构示意图;FIG. 6 is a schematic structural diagram of a story content generating apparatus based on a picture content according to another embodiment of the present invention; FIG.
图7是根据本发明又一个实施例提供的基于图片内容的故事生成装置的结构示意图。 FIG. 7 is a schematic structural diagram of a story content generating apparatus based on a picture content according to another embodiment of the present invention.
具体实施方式detailed description
下面详细描述本发明的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的元件或具有相同或类似功能的元件。下面通过参考附图描述的实施例是示例性的,旨在用于解释本发明,而不能理解为对本发明的限制。The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.
下面参考附图描述本发明实施例的基于图片内容的故事生成方法和装置。A method and apparatus for generating a story based on picture content according to an embodiment of the present invention will be described below with reference to the accompanying drawings.
图1是根据本发明一个实施例提供的基于图片内容的故事生成方法的流程图。FIG. 1 is a flowchart of a method for generating a story based on a picture content according to an embodiment of the present invention.
需要说明的是,本申请实施例的基于图片内容的故事生成方法可以应用在Android、IOS、PC等系统的设备(手机、平板、电脑等设备)中。It should be noted that the picture content-based story generation method in the embodiment of the present application can be applied to devices (mobile phones, tablets, computers, etc.) of Android, IOS, PC, and the like.
具体地,图片内容识别是指对图片进行解释,可以识别出图片中包含的物体、图片的拍摄场景等。通常图片内容识别方法是物体检测法即通过定义一系列模板,使每个模板捕捉某种特定类型的物体。Specifically, the picture content recognition refers to interpreting the picture, and can identify an object included in the picture, a shooting scene of the picture, and the like. Usually the image content recognition method is object detection, that is, by defining a series of templates, each template captures a certain type of object.
然而,上述识别得到的结果比较单一,不能够应用于人工智能的图片识别技术中。为了进一步提高人工智能的便利性和趣味性,本发明提出一种基于图片内容的故事生成方法,通过将识别后的图片内容进行进一步的泛化处理后生成与图片对应的故事并进行播放。具体如下:However, the above recognition results are relatively simple and cannot be applied to the artificial image recognition technology. In order to further improve the convenience and interest of artificial intelligence, the present invention provides a story generation method based on picture content, and further generalizes the recognized picture content to generate a story corresponding to the picture and play it. details as follows:
如图1所示,该基于图片内容的故事生成方法包括以下步骤:As shown in FIG. 1, the image content-based story generation method includes the following steps:
步骤101,识别图片内容提取关键词。Step 101: Identify a picture content extraction keyword.
步骤102,获取与关键词相关的泛化词。Step 102: Obtain a generalized word related to the keyword.
具体地,可以通过图片识别软件或者算法等方式对图片进行处理以识别出图片内容,并对图片内容进行处理提取关键词。可以理解的是,提取出若干个代表图片内容的词汇或短语作为关键词。Specifically, the picture may be processed by a picture recognition software or an algorithm to identify the picture content, and the picture content is processed to extract keywords. It can be understood that a number of words or phrases representing picture content are extracted as keywords.
进一步地,可以通过很多种方式获取与关键词相关的泛化词,作为一种示例,查询预设的近义词库获取与关键词对应的近义词,查询预先训练的关联词库获取与关键词对应的关联词。Further, the generalized word related to the keyword can be obtained in a plurality of ways. As an example, the predetermined synonym database is used to obtain a synonym corresponding to the keyword, and the pre-trained related vocabulary is obtained by querying the corresponding vocabulary. Related words.
举例而言,通过对图2所示的图片进行识别内容提取关键词为“女孩”、“女人”等,接着在预设的近义词库中查询与“女孩”、“女人”等对应的近义词比如“女生”、“女神”、“佳人”等,再查询预先训练的关联词库,比如“女生”对应“可爱”、“萌萌哒”等,由此可以获取到“女神”、“女生”、“模特”、“佳人”、“可爱”、“漂亮”、“美美哒”、“美女”、“萌萌哒”等近义词及关联词作为与关键词相关的泛化词。For example, by extracting keywords from the picture shown in FIG. 2, the keywords are “girl”, “woman”, etc., and then querying the synonyms of “girl”, “woman”, etc. in the preset synonym database, for example. “Girls”, “Goddess”, “Beautiful People”, etc., and then query the pre-trained related vocabulary. For example, “girls” correspond to “cute” and “meng Meng”, so that “Goddess” and “Girls” can be obtained. Synonyms and related words such as "model", "beauty", "cute", "beautiful", "beautiful", "beauty", "meng Meng" are used as generalization words related to keywords.
其中,近义词库是预先设置的,比如“美女”“女孩”是近义词;“厉害”、“太棒啦”是近义词等等,可以根据需要对近义词库进行调整即增加或者减少近义词的数量。近义词库中保存着多个近义词的相互关系(其形式可以是映射表等形式),比如通过关键词X可以查 找对应的映射表(还可以是通过相关算法计算等方式)找到其近义词Y、Z,或者更多的近义词。Among them, the thesaurus is pre-set, such as "beauty" and "girl" are synonymous words; "severe", "great" is a synonym, etc., and the lexicon can be adjusted as needed to increase or decrease the number of synonyms. The synonym database holds the relationship of multiple synonyms (the form can be a mapping table, etc.), for example, by keyword X. Find the corresponding mapping table (which can also be calculated by related algorithms, etc.) to find the synonym Y, Z, or more synonyms.
需要说明的是,可以通过很多种方式训练关联词库,作为一种示例,对样本集合中的信息内容进行切词处理生成多个词单元,根据词单元之间的共现次数和预设阈值生成关联词库。即可以通过对大量词单元之间的关联性进行评估,比如两个词单元一起出现的次数大于预设阈值比如10次,则将这两个词单元设置为关联词保存在关联词库中。It should be noted that the related vocabulary can be trained in a plurality of ways. As an example, the information content in the sample set is subjected to word-cutting processing to generate a plurality of word units, according to the number of co-occurrences between the word units and a preset threshold. Generate a related term library. That is, the correlation between a large number of word units can be evaluated. For example, if the number of occurrences of two word units together is greater than a preset threshold, for example, 10 times, the two word units are set as related words and stored in the associated thesaurus.
步骤103,根据预先训练的故事词句关联信息库生成与关键词和泛化词相关的句子。Step 103: Generate a sentence related to the keyword and the generalized word according to the pre-trained story-word-related information base.
步骤104,根据预设的逻辑规则对句子进行排序处理生成与图片对应的故事并进行播放。Step 104: Sort the sentence according to a preset logic rule to generate a story corresponding to the picture and play it.
具体地,预先需要训练生成故事词句关联信息库,可以理解的是,生成故事词句关联信息库的方式有很多种,可以根据实际应用需要进行选择设置,举例说明如下:Specifically, it is necessary to train and generate a story-to-speech information base in advance. It can be understood that there are many ways to generate a story-word-related information base, which can be selected according to actual application requirements, as illustrated below:
作为一种示例,对故事样本中的信息内容进行切词和断句处理生成多个词单元和句单元;根据词单元和句单元之间的共现次数和预设阈值生成故事词句关联信息库。即可以通过大量故事样本中的信息内容确定词单元和句单元之间的关联性,比如一个词单元和一个句单元一起出现的次数大于预设阈值比如10次,则将这词单元和句单元保存在故事词句关联信息库中。As an example, the information content in the story sample is subjected to word-cutting and sentence-breaking processing to generate a plurality of word units and sentence units; and the story-word-related information base is generated according to the number of co-occurrences between the word unit and the sentence unit and the preset threshold. That is, the relationship between the word unit and the sentence unit can be determined by the information content in a large number of story samples. For example, if a word unit and a sentence unit appear together more than a preset threshold, for example, 10 times, the word unit and the sentence unit are Saved in the story-related information library.
举例而言,比如“有一只小花猫”这句单元和“喵喵叫”这个词单元总是同时出现在一个故事中,那么这句单元和这个词单元的评分就会较高即出现次数大于预设阈值,从而被作为故事词句关联信息保存在故事词句关联信息库中。For example, if the unit "has a little cat" and the unit of "howling" always appear in one story at the same time, then the score of the unit and the unit of the word will be higher, that is, the number of occurrences is greater than The threshold is preset so as to be stored in the story-related information base as the story-related information.
进一步地,根据预先训练的故事词句关联信息库生成与关键词和泛化词相关的句子,即通过关键词、泛化词和预先训练的故事词句关联信息库可以得到的相关的句子,进行关联创作出一个全新的故事。Further, the sentence related to the keyword and the generalized word is generated according to the pre-trained story-word-related information base, that is, the related sentence that can be obtained through the keyword, the generalized word, and the pre-trained story-word-related information base is associated. Create a whole new story.
进一步地,故事是具有连续性的,即具有一定的情节。可以理解的是,得到相关的句子有很多,需要通过预先设置的逻辑规则对多个句子进行排序处理生成图片对应的故事并进行播放。Further, the story is continuous, that is, has a certain plot. It can be understood that there are many related sentences, and it is necessary to sort and process a plurality of sentences through a preset logic rule to generate a story corresponding to the image and play it.
作为一种场景实现,用户上传一张图片如图3所示,可以自动匹配生成图片对应的故事“从前,有一个特别漂亮的小女孩,她非常爱笑,她还有一头美丽的秀发,她爱阳光,是个特别开朗的人,大家都喜欢她,为什么大家都喜欢她呢?就是因为人们都喜欢爱笑的人,你也要多笑一笑哦”。由此,进一步提高人工智能的趣味性。As a scene implementation, the user uploads a picture as shown in Figure 3. It can automatically match the story corresponding to the generated picture. "In the past, there was a very beautiful little girl. She was very funny, she also had a beautiful hair. She loves the sun, she is a very cheerful person, everyone likes her, why do everyone like her? Just because people like people who love to laugh, you have to smile more." Thereby, the interest of artificial intelligence is further improved.
综上所述,本发明实施例的基于图片内容的故事生成方法,通过识别图片内容提取关键词,并获取与关键词相关的泛化词,然后根据预先训练的故事词句关联信息库生成与关键词和泛化词相关的句子,最后根据预设的逻辑规则对句子进行排序处理生成与图片对应的故事并进行播放,实现将识别后的图片内容进行进一步的泛化处理后生成与图片对应的故事并进 行播放,提高了人工智能的便利性和趣味性,提升了用户体验。In summary, the method for generating a story based on a picture content according to an embodiment of the present invention extracts a keyword by recognizing a picture content, acquires a generalization word related to the keyword, and then generates and keys according to the pre-trained story phrase association information base. The words related to the generalized words are finally sorted according to the preset logic rules to generate a story corresponding to the picture and played, so that the recognized picture content is further generalized and then generated corresponding to the picture. The story goes hand in hand Line playback improves the convenience and fun of artificial intelligence and enhances the user experience.
图4是根据本发明另一个实施例提供的基于图片内容的故事生成方法的流程图。如图4所示,在步骤104之前,还包括:FIG. 4 is a flowchart of a method for generating a story based on a picture content according to another embodiment of the present invention. As shown in FIG. 4, before step 104, the method further includes:
步骤201,获取与关键词对应的第一权重以及与泛化词对应的第二权重。Step 201: Acquire a first weight corresponding to the keyword and a second weight corresponding to the generalized word.
步骤202,根据第一权重与第二权重对相关的句子进行筛选。Step 202: Filter related sentences according to the first weight and the second weight.
具体地,用户可以根据实际应用需要给予关键词和泛化词不同的权重,比如关键词对应的第一权重为0.4;泛化词对应的第二权重为0.6等。从而可以得到满足需求的相关句子,进一步提高用户体验。Specifically, the user may give different weights to the keyword and the generalized word according to actual application requirements, for example, the first weight corresponding to the keyword is 0.4; the second weight corresponding to the generalized word is 0.6. Thereby, relevant sentences satisfying the requirements can be obtained, and the user experience is further improved.
为了实现上述实施例,本发明提出了一种基于图片内容的故事生成装置。In order to implement the above embodiment, the present invention proposes a story generating device based on picture content.
图5是根据本发明一个实施例提供的基于图片内容的故事生成装置的流程图。FIG. 5 is a flowchart of a picture content based story generating apparatus according to an embodiment of the present invention.
如图5所示,该基于图片内容的故事生成装置包括:提取模块11、第一获取模块12、第一生成模块13和处理模块14。As shown in FIG. 5, the picture content-based story generating apparatus includes an extracting module 11, a first obtaining module 12, a first generating module 13, and a processing module 14.
其中,提取模块11,用于识别图片内容提取关键词。The extraction module 11 is configured to identify a picture content extraction keyword.
第一获取模块12,用于获取与关键词相关的泛化词。The first obtaining module 12 is configured to obtain a generalized word related to the keyword.
第一生成模块13,用于根据预先训练的故事词句关联信息库生成与关键词和泛化词相关的句子。The first generating module 13 is configured to generate a sentence related to the keyword and the generalized word according to the pre-trained story-word-related information base.
处理模块14,用于根据预设的逻辑规则对句子进行排序处理生成与图片对应的故事并进行播放。The processing module 14 is configured to perform a sorting process on the sentence according to a preset logic rule to generate a story corresponding to the picture and play the same.
进一步地,获取模块12,用于查询预设的近义词库获取与关键词对应的近义词,以及查询预先训练的关联词库获取与关键词对应的关联词。Further, the obtaining module 12 is configured to query a preset synonym database to obtain a synonym corresponding to the keyword, and query the pre-trained related vocabulary to acquire an associated word corresponding to the keyword.
进一步地,获取模块12,还用于对样本集合中的信息内容进行切词处理生成多个词单元;根据词单元之间的共现次数和预设阈值生成关联词库。Further, the obtaining module 12 is further configured to perform word segmentation processing on the information content in the sample set to generate a plurality of word units; and generate a related term database according to the co-occurrence number between the word units and the preset threshold.
进一步地,如图6所示,在图5的基础上,该基于图片内容的故事生成装置还包括:第二生成模块15、第三生成模块16、第二获取模块17和筛选模块18。Further, as shown in FIG. 6, on the basis of FIG. 5, the picture content-based story generating apparatus further includes: a second generating module 15, a third generating module 16, a second obtaining module 17, and a screening module 18.
其中,第二生成模块15,用于对故事样本中的信息内容进行切词和断句处理生成多个词单元和句单元。The second generation module 15 is configured to perform word segmentation and sentence segment processing on the information content in the story sample to generate a plurality of word units and sentence units.
第三生成模块16,用于根据词单元和句单元之间的共现次数和预设阈值生成故事词句关联信息库。The third generation module 16 is configured to generate a story-word association information base according to the number of co-occurrences between the word unit and the sentence unit and the preset threshold.
第二获取模块17,用于获取与关键词对应的第一权重以及与泛化词对应的第二权重。The second obtaining module 17 is configured to acquire a first weight corresponding to the keyword and a second weight corresponding to the generalized word.
筛选模块18,用于根据第一权重与第二权重对相关的句子进行筛选。The screening module 18 is configured to filter related sentences according to the first weight and the second weight.
需要说明的是,前述对基于图片内容的故事生成方法实施例的解释说明也适用于该实施例的基于图片内容的故事生成装置,此处不再赘述。 It should be noted that the foregoing explanation of the embodiment of the method for generating a story based on the picture content is also applicable to the image content-based story generating device of the embodiment, and details are not described herein again.
综上所述,本发明实施例的基于图片内容的故事生成装置,通过识别图片内容提取关键词,并获取与关键词相关的泛化词,然后根据预先训练的故事词句关联信息库生成与关键词和泛化词相关的句子,最后根据预设的逻辑规则对句子进行排序处理生成与图片对应的故事并进行播放,实现将识别后的图片内容进行进一步的泛化处理后生成与图片对应的故事并进行播放,提高了人工智能的便利性和趣味性,提升了用户体验。In summary, the picture content-based story generating apparatus of the embodiment of the present invention extracts keywords by recognizing the picture content, acquires generalized words related to the keywords, and then generates and keys according to the pre-trained story words and related information bases. The words related to the generalized words are finally sorted according to the preset logic rules to generate a story corresponding to the picture and played, so that the recognized picture content is further generalized and then generated corresponding to the picture. The story is played and played, which improves the convenience and fun of artificial intelligence and enhances the user experience.
图7是根据本发明又一个实施例提供的基于图片内容的故事生成装置的流程图。如图7所示,该基于图片内容的故事生成装置包括:FIG. 7 is a flowchart of a picture content-based story generating apparatus according to still another embodiment of the present invention. As shown in FIG. 7, the picture content-based story generating device includes:
存储器21、处理器22及存储在存储器21上并可在处理器22上运行的计算机程序。The memory 21, the processor 22, and a computer program stored on the memory 21 and operable on the processor 22.
处理器22执行所述程序时实现上述实施例中提供的基于图片内容的故事生成方法。The processor 22 executes the program to implement the picture content based story generation method provided in the above embodiment.
进一步地,基于图片内容的故事生成装置还包括:Further, the story content generating device based on the image content further includes:
通信接口23,用于存储器21和处理器22之间的通信。 Communication interface 23 is used for communication between memory 21 and processor 22.
存储器21,用于存放可在处理器22上运行的计算机程序。The memory 21 is for storing a computer program executable on the processor 22.
存储器21可能包含高速RAM存储器,也可能还包括非易失性存储器(non-volatile memory),例如至少一个磁盘存储器。The memory 21 may include a high speed RAM memory and may also include a non-volatile memory such as at least one disk memory.
处理器22,用于执行所述程序时实现上述实施例所述的基于图片内容的故事生成方法。The processor 22 is configured to implement the picture content-based story generation method described in the foregoing embodiment when the program is executed.
如果存储器21、处理器22和通信接口23独立实现,则通信接口21、存储器21和处理器22可以通过总线相互连接并完成相互间的通信。所述总线可以是工业标准体系结构(Industry Standard Architecture,简称为ISA)总线、外部设备互连(Peripheral Component,简称为PCI)总线或扩展工业标准体系结构(Extended Industry Standard Architecture,简称为EISA)总线等。所述总线可以分为地址总线、数据总线、控制总线等。为便于表示,图7中仅用一条粗线表示,但并不表示仅有一根总线或一种类型的总线。If the memory 21, the processor 22, and the communication interface 23 are independently implemented, the communication interface 21, the memory 21, and the processor 22 can be connected to each other through a bus and complete communication with each other. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. Wait. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 7, but it does not mean that there is only one bus or one type of bus.
可选的,在具体实现上,如果存储器21、处理器22及通信接口23,集成在一块芯片上实现,则存储器21、处理器22及通信接口23可以通过内部接口完成相互间的通信。Optionally, in a specific implementation, if the memory 21, the processor 22, and the communication interface 23 are integrated on one chip, the memory 21, the processor 22, and the communication interface 23 can complete communication with each other through the internal interface.
处理器22可能是一个中央处理器(Central Processing Unit,简称为CPU),或者是特定集成电路(Application Specific Integrated Circuit,简称为ASIC),或者是被配置成实施本发明实施例的一个或多个集成电路。The processor 22 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more configured to implement the embodiments of the present invention. integrated circuit.
为了实现上述实施例,本发明还提出计算机设备,其特征在于,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时,使得能够执行一种基于图片内容的故事生成方法,所述方法包括:识别图片内容提取关键词;获取与关键词相关的泛化词;根据预先训练的故事词句关联信息库生成与关键词和泛化词相关的句子;根据预设的逻辑规则对句子进行排序处理生成与图片对应的故事并进行播放。 In order to achieve the above embodiments, the present invention also provides a computer device, comprising: a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the program </ RTI> enabling a story content generation method based on picture content, the method comprising: identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; generating and keywords according to the pre-trained story word association information base A sentence related to a generalized word; sorting the sentence according to a preset logical rule to generate a story corresponding to the picture and playing it.
为了实现上述实施例,本发明还提出一种非临时性计算机可读存储介质,当所述存储介质中的指令由处理器被执行时,使得能够执行一种基于图片内容的故事生成方法,所述方法包括:识别图片内容提取关键词;获取与关键词相关的泛化词;根据预先训练的故事词句关联信息库生成与关键词和泛化词相关的句子;根据预设的逻辑规则对句子进行排序处理生成与图片对应的故事并进行播放。In order to implement the above embodiments, the present invention also provides a non-transitory computer readable storage medium, enabling execution of a story content generation method based on picture content when instructions in the storage medium are executed by a processor The method includes: identifying a picture content extraction keyword; acquiring a generalization word related to the keyword; generating a sentence related to the keyword and the generalization word according to the pre-trained story word association information base; and the sentence according to the preset logic rule Sorting is performed to generate a story corresponding to the picture and play it.
为了实现上述实施例,本发明还提出一种计算机程序产品,当所述计算机程序产品中的指令处理器执行时,使得能够执行一种基于图片内容的故事生成方法,所述方法包括:识别图片内容提取关键词;获取与关键词相关的泛化词;根据预先训练的故事词句关联信息库生成与关键词和泛化词相关的句子;根据预设的逻辑规则对句子进行排序处理生成与图片对应的故事并进行播放。In order to achieve the above embodiments, the present invention also provides a computer program product, which, when executed by an instruction processor in the computer program product, enables execution of a picture content based story generation method, the method comprising: identifying a picture Content extraction keywords; obtaining generalization words related to keywords; generating sentences related to keywords and generalization words according to pre-trained story-word association information base; sorting processing sentences according to preset logic rules to generate images Corresponding stories are played and played.
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本发明的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的限定。Moreover, the terms "first" and "second" are used for descriptive purposes only and are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, features defining "first" or "second" may include at least one of the features, either explicitly or implicitly. In the description of the present invention, the meaning of "a plurality" is at least two, such as two, three, etc., unless specifically defined otherwise.
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本发明的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of the present specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" and the like means a specific feature described in connection with the embodiment or example. A structure, material or feature is included in at least one embodiment or example of the invention. In the present specification, the schematic representation of the above terms is not necessarily directed to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in a suitable manner in any one or more embodiments or examples. In addition, various embodiments or examples described in the specification, as well as features of various embodiments or examples, may be combined and combined.
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现定制逻辑功能或过程的步骤的可执行指令的代码的模块、片段或部分,并且本发明的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本发明的实施例所属技术领域的技术人员所理解。Any process or method description in the flowcharts or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a custom logic function or process. And the scope of the preferred embodiments of the invention includes additional implementations, in which the functions may be performed in a substantially simultaneous manner or in an opposite order depending on the functions involved, in the order shown or discussed. It will be understood by those skilled in the art to which the embodiments of the present invention pertain.
在流程图中表示或在此以其他方式描述的逻辑和/或步骤,例如,可以被认为是用于实现逻辑功能的可执行指令的定序列表,可以具体实现在任何计算机可读介质中,以供指令执行系统、装置或设备(如基于计算机的系统、包括处理器的系统或其他可以从指令执行系统、装置或设备取指令并执行指令的系统)使用,或结合这些指令执行系统、装置或设备而使用。就本说明书而言,"计算机可读介质"可以是任何可以包含、存储、通信、传播或传输程序以供指令执行系统、装置或设备或结合这些指令执行系统、装置或设备而使用的装置。计算机 可读介质的更具体的示例(非穷尽性列表)包括以下:具有一个或多个布线的电连接部(电子装置),便携式计算机盘盒(磁装置),随机存取存储器(RAM),只读存储器(ROM),可擦除可编辑只读存储器(EPROM或闪速存储器),光纤装置,以及便携式光盘只读存储器(CDROM)。另外,计算机可读介质甚至可以是可在其上打印所述程序的纸或其他合适的介质,因为可以例如通过对纸或其他介质进行光学扫描,接着进行编辑、解译或必要时以其他合适方式进行处理来以电子方式获得所述程序,然后将其存储在计算机存储器中。The logic and/or steps represented in the flowchart or otherwise described herein, for example, may be considered as an ordered list of executable instructions for implementing logical functions, and may be embodied in any computer readable medium, Used in conjunction with, or in conjunction with, an instruction execution system, apparatus, or device (eg, a computer-based system, a system including a processor, or other system that can fetch instructions and execute instructions from an instruction execution system, apparatus, or device) Or use with equipment. For the purposes of this specification, a "computer-readable medium" can be any apparatus that can contain, store, communicate, propagate, or transport a program for use in an instruction execution system, apparatus, or device, or in conjunction with the instruction execution system, apparatus, or device. Computer More specific examples (non-exhaustive list) of readable media include the following: electrical connections (electronic devices) with one or more wires, portable computer disk cartridges (magnetic devices), random access memory (RAM), only Read memory (ROM), erasable editable read only memory (EPROM or flash memory), fiber optic devices, and portable compact disk read only memory (CDROM). In addition, the computer readable medium may even be a paper or other suitable medium on which the program can be printed, as it may be optically scanned, for example by paper or other medium, followed by editing, interpretation or, if appropriate, other suitable The method is processed to obtain the program electronically and then stored in computer memory.
应当理解,本发明的各部分可以用硬件、软件、固件或它们的组合来实现。在上述实施方式中,多个步骤或方法可以用存储在存储器中且由合适的指令执行系统执行的软件或固件来实现。如,如果用硬件来实现和在另一实施方式中一样,可用本领域公知的下列技术中的任一项或他们的组合来实现:具有用于对数据信号实现逻辑功能的逻辑门电路的离散逻辑电路,具有合适的组合逻辑门电路的专用集成电路,可编程门阵列(PGA),现场可编程门阵列(FPGA)等。It should be understood that portions of the invention may be implemented in hardware, software, firmware or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware and in another embodiment, it can be implemented by any one or combination of the following techniques well known in the art: discrete with logic gates for implementing logic functions on data signals Logic circuits, application specific integrated circuits with suitable combinational logic gates, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), and the like.
本技术领域的普通技术人员可以理解实现上述实施例方法携带的全部或部分步骤是可以通过程序来指令相关的硬件完成,所述的程序可以存储于一种计算机可读存储介质中,该程序在执行时,包括方法实施例的步骤之一或其组合。One of ordinary skill in the art can understand that all or part of the steps carried by the method of implementing the above embodiments can be completed by a program to instruct related hardware, and the program can be stored in a computer readable storage medium. When executed, one or a combination of the steps of the method embodiments is included.
此外,在本发明各个实施例中的各功能单元可以集成在一个处理模块中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。所述集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules. The integrated modules, if implemented in the form of software functional modules and sold or used as stand-alone products, may also be stored in a computer readable storage medium.
上述提到的存储介质可以是只读存储器,磁盘或光盘等。尽管上面已经示出和描述了本发明的实施例,可以理解的是,上述实施例是示例性的,不能理解为对本发明的限制,本领域的普通技术人员在本发明的范围内可以对上述实施例进行变化、修改、替换和变型。 The above mentioned storage medium may be a read only memory, a magnetic disk or an optical disk or the like. Although the embodiments of the present invention have been shown and described, it is understood that the above-described embodiments are illustrative and are not to be construed as limiting the scope of the invention. The embodiments are subject to variations, modifications, substitutions and variations.

Claims (13)

  1. 一种基于图片内容的故事生成方法,其特征在于,包括以下步骤:A method for generating a story based on picture content, comprising the steps of:
    识别图片内容提取关键词;Identifying picture content extraction keywords;
    获取与所述关键词相关的泛化词;Obtaining generalized words related to the keyword;
    根据预先训练的故事词句关联信息库生成与所述关键词和所述泛化词相关的句子;Generating a sentence related to the keyword and the generalized word according to a pre-trained story-phrase association information base;
    根据预设的逻辑规则对所述句子进行排序处理生成与所述图片对应的故事并进行播放。The sentence is sorted according to a preset logic rule to generate a story corresponding to the picture and played.
  2. 如权利要求1所述的方法,其特征在于,所述获取与所述关键词相关的泛化词,包括:The method of claim 1 wherein said obtaining a generalized word associated with said keyword comprises:
    查询预设的近义词库获取与所述关键词对应的近义词,以及Querying a preset synonym to obtain a synonym corresponding to the keyword, and
    查询预先训练的关联词库获取与所述关键词对应的关联词。Querying the pre-trained related vocabulary to obtain the related words corresponding to the keyword.
  3. 如权利要求2所述的方法,其特征在于,还包括:The method of claim 2, further comprising:
    对样本集合中的信息内容进行切词处理生成多个词单元;Performing word-cutting on the information content in the sample set to generate a plurality of word units;
    根据词单元之间的共现次数和预设阈值生成关联词库。A related vocabulary is generated according to the number of co-occurrences between word units and a preset threshold.
  4. 如权利要求1-3任一项所述的方法,其特征在于,还包括:The method of any of claims 1-3, further comprising:
    对故事样本中的信息内容进行切词和断句处理生成多个词单元和句单元;Performing word-cutting and sentence-breaking processing on the information content in the sample of the story to generate a plurality of word units and sentence units;
    根据词单元和句单元之间的共现次数和预设阈值生成所述故事词句关联信息库。The story-word association information base is generated according to the co-occurrence number between the word unit and the sentence unit and a preset threshold.
  5. 如权利要求1-4任一项所述的方法,其特征在于,在所述根据预设的逻辑规则对所述句子进行排序处理生成与所述图片对应的故事并进行播放之前,还包括:The method according to any one of claims 1-4, wherein before the step of sorting the sentence according to a preset logic rule to generate a story corresponding to the picture and playing the file, the method further includes:
    获取与所述关键词对应的第一权重以及与所述泛化词对应的第二权重;Obtaining a first weight corresponding to the keyword and a second weight corresponding to the generalized word;
    根据所述第一权重与所述第二权重对所述相关的句子进行筛选。The related sentences are filtered according to the first weight and the second weight.
  6. 一种基于图片内容的故事生成装置,其特征在于,包括:A story generating device based on picture content, comprising:
    提取模块,用于识别图片内容提取关键词;An extraction module, configured to identify a picture content extraction keyword;
    第一获取模块,用于获取与所述关键词相关的泛化词;a first obtaining module, configured to acquire a generalized word related to the keyword;
    第一生成模块,用于根据预先训练的故事词句关联信息库生成与所述关键词和所述泛化词相关的句子;a first generating module, configured to generate a sentence related to the keyword and the generalized word according to a pre-trained story-word association information base;
    处理模块,用于根据预设的逻辑规则对所述句子进行排序处理生成与所述图片对应的故事并进行播放。And a processing module, configured to perform a sorting process on the sentence according to a preset logic rule to generate a story corresponding to the image and play the same.
  7. 如权利要求6所述的装置,其特征在于,所述获取模块用于:The apparatus according to claim 6, wherein said obtaining module is configured to:
    查询预设的近义词库获取与所述关键词对应的近义词,以及Querying a preset synonym to obtain a synonym corresponding to the keyword, and
    查询预先训练的关联词库获取与所述关键词对应的关联词。Querying the pre-trained related vocabulary to obtain the related words corresponding to the keyword.
  8. 如权利要求7所述的装置,其特征在于,所述获取模块还用于:The device according to claim 7, wherein the obtaining module is further configured to:
    对样本集合中的信息内容进行切词处理生成多个词单元; Performing word-cutting on the information content in the sample set to generate a plurality of word units;
    根据词单元之间的共现次数和预设阈值生成关联词库。A related vocabulary is generated according to the number of co-occurrences between word units and a preset threshold.
  9. 如权利要求6-8任一项所述的装置,其特征在于,还包括:The device of any of claims 6-8, further comprising:
    第二生成模块,用于对故事样本中的信息内容进行切词和断句处理生成多个词单元和句单元;a second generating module, configured to perform word cutting and sentence processing on the information content in the story sample to generate a plurality of word units and sentence units;
    第三生成模块,用于根据词单元和句单元之间的共现次数和预设阈值生成所述故事词句关联信息库。The third generation module is configured to generate the story-word association information base according to the co-occurrence number between the word unit and the sentence unit and the preset threshold.
  10. 如权利要求6-9任一项所述的装置,其特征在于,还包括:The device of any of claims 6-9, further comprising:
    第二获取模块,用于获取与所述关键词对应的第一权重以及与所述泛化词对应的第二权重;a second acquiring module, configured to acquire a first weight corresponding to the keyword and a second weight corresponding to the generalized word;
    筛选模块,用于根据所述第一权重与所述第二权重对所述相关的句子进行筛选。a screening module, configured to filter the related sentence according to the first weight and the second weight.
  11. 一种计算机设备,其特征在于,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时,实现如权利要求1-5中任一项所述的方法。A computer device, comprising: a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein when the processor executes the program, the implementation is as claimed in claim 1 The method of any of 5.
  12. 一种非临时性计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现如权利要求1-5中任一项所述的方法。A non-transitory computer readable storage medium having stored thereon a computer program, wherein the program, when executed by a processor, implements the method of any of claims 1-5.
  13. 一种计算机程序产品,当所述计算机程序产品中的指令由处理器执行时,执行如权利要求1-5中任一项所述的方法。 A computer program product for performing the method of any of claims 1-5 when the instructions in the computer program product are executed by a processor.
PCT/CN2017/100329 2017-05-19 2017-09-04 Method and apparatus for generating stories on the basis of picture content WO2018209845A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710359135.0A CN107193941A (en) 2017-05-19 2017-05-19 Story generation method and device based on picture content
CN201710359135.0 2017-05-19

Publications (1)

Publication Number Publication Date
WO2018209845A1 true WO2018209845A1 (en) 2018-11-22

Family

ID=59875363

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/100329 WO2018209845A1 (en) 2017-05-19 2017-09-04 Method and apparatus for generating stories on the basis of picture content

Country Status (2)

Country Link
CN (1) CN107193941A (en)
WO (1) WO2018209845A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107948730B (en) * 2017-10-30 2020-11-20 百度在线网络技术(北京)有限公司 Method, device and equipment for generating video based on picture and storage medium
WO2019109245A1 (en) 2017-12-05 2019-06-13 华为技术有限公司 Method and device for displaying story album
CN108986785B (en) * 2018-08-08 2021-06-08 科大讯飞股份有限公司 Text recomposition method and device
CN110941960A (en) * 2019-11-12 2020-03-31 广州爱学信息科技有限公司 Keyword-based children picture story generation method, system and equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103827961A (en) * 2011-10-28 2014-05-28 日立公共系统有限公司 Apparatus for providing text data with synthesized voice information and method for providing text data
CN104951554A (en) * 2015-06-29 2015-09-30 浙江大学 Method for matching landscape with verses according with artistic conception of landscape
CN106203465A (en) * 2016-06-24 2016-12-07 百度在线网络技术(北京)有限公司 A kind of method and device generating the music score of Chinese operas based on image recognition
CN107025312A (en) * 2017-05-19 2017-08-08 北京金山安全软件有限公司 Information providing method and device based on video content
CN107122492A (en) * 2017-05-19 2017-09-01 北京金山安全软件有限公司 Lyric generation method and device based on picture content

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104142936A (en) * 2013-05-07 2014-11-12 腾讯科技(深圳)有限公司 Audio and video match method and audio and video match device
CN103678668A (en) * 2013-12-24 2014-03-26 乐视网信息技术(北京)股份有限公司 Prompting method of relevant search result, server and system
CN105868155A (en) * 2016-05-11 2016-08-17 黄芳 Story generation equipment and method
CN106202183A (en) * 2016-06-24 2016-12-07 四川长虹电器股份有限公司 A kind of realize automatically joining literary composition and dub in background music the method for generation phonic photograph album/e-book

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103827961A (en) * 2011-10-28 2014-05-28 日立公共系统有限公司 Apparatus for providing text data with synthesized voice information and method for providing text data
CN104951554A (en) * 2015-06-29 2015-09-30 浙江大学 Method for matching landscape with verses according with artistic conception of landscape
CN106203465A (en) * 2016-06-24 2016-12-07 百度在线网络技术(北京)有限公司 A kind of method and device generating the music score of Chinese operas based on image recognition
CN107025312A (en) * 2017-05-19 2017-08-08 北京金山安全软件有限公司 Information providing method and device based on video content
CN107122492A (en) * 2017-05-19 2017-09-01 北京金山安全软件有限公司 Lyric generation method and device based on picture content

Also Published As

Publication number Publication date
CN107193941A (en) 2017-09-22

Similar Documents

Publication Publication Date Title
US10430689B2 (en) Training a classifier algorithm used for automatically generating tags to be applied to images
Harwath et al. Vision as an interlingua: Learning multilingual semantic embeddings of untranscribed speech
US11531818B2 (en) Device and method for machine reading comprehension question and answer
US10157619B2 (en) Method and device for searching according to speech based on artificial intelligence
WO2018209845A1 (en) Method and apparatus for generating stories on the basis of picture content
CN107480122B (en) Artificial intelligence interaction method and artificial intelligence interaction device
CN110427463A (en) Search statement response method, device and server and storage medium
CN106446018B (en) Query information processing method and device based on artificial intelligence
CN108538286A (en) A kind of method and computer of speech recognition
US20140172419A1 (en) System and method for generating personalized tag recommendations for tagging audio content
JP2020166839A (en) Sentence recommendation method and apparatus based on associated points of interest
CN107122492A (en) Lyric generation method and device based on picture content
CN111291177A (en) Information processing method and device and computer storage medium
CN108073565A (en) The method and apparatus and machine translation method and equipment of words criterion
CN111309916B (en) Digest extracting method and apparatus, storage medium, and electronic apparatus
Younessian et al. Multimodal knowledge-based analysis in multimedia event detection
US20220093082A1 (en) Automatically Adding Sound Effects Into Audio Files
WO2021218432A1 (en) Method and apparatus for interpreting picture book, electronic device and smart robot
CN107025312A (en) Information providing method and device based on video content
CN106372231A (en) Search method and device
CN114595692A (en) Emotion recognition method, system and terminal equipment
KR102192342B1 (en) Method and device for multimodal character identification on multiparty dialogues
Asadi et al. Real-Time Presentation Tracking Using Semantic Keyword Spotting.
Henri et al. A deep transfer learning model for the identification of bird songs: A case study for Mauritius
Khan et al. A framework for creating natural language descriptions of video streams

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17910077

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17910077

Country of ref document: EP

Kind code of ref document: A1