CN113360797B - Information processing method, apparatus, device, storage medium, and computer program product - Google Patents

Information processing method, apparatus, device, storage medium, and computer program product Download PDF

Info

Publication number
CN113360797B
CN113360797B CN202110693412.8A CN202110693412A CN113360797B CN 113360797 B CN113360797 B CN 113360797B CN 202110693412 A CN202110693412 A CN 202110693412A CN 113360797 B CN113360797 B CN 113360797B
Authority
CN
China
Prior art keywords
content
target
information
panoramic
processed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110693412.8A
Other languages
Chinese (zh)
Other versions
CN113360797A (en
Inventor
张昊
白国财
辛建康
冯程炜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Baidu Netcom Science and Technology Co Ltd
Original Assignee
Beijing Baidu Netcom Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Baidu Netcom Science and Technology Co Ltd filed Critical Beijing Baidu Netcom Science and Technology Co Ltd
Priority to CN202110693412.8A priority Critical patent/CN113360797B/en
Publication of CN113360797A publication Critical patent/CN113360797A/en
Application granted granted Critical
Publication of CN113360797B publication Critical patent/CN113360797B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9538Presentation of query results

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The disclosure provides an information processing method, an information processing device, electronic equipment, a computer readable storage medium and a computer program product, and relates to the technical fields of panoramic images, cloud services, natural language processing and the like. The method comprises the following steps: determining a target position corresponding to the information to be processed according to the content contained in the information to be processed; determining target panoramic content corresponding to the target position; and mounting the target panoramic content into the information to be processed to obtain the processed information. According to the method, after the target position corresponding to the information to be processed is determined, the matched target panoramic content is determined based on the target position, and finally, the novel processed information of the panoramic content fused with the target position is obtained by mounting the target panoramic content into the information to be processed, so that a technical basis is provided for introducing a virtual display technology, and the information viewing experience and substitution sense of a user are improved.

Description

Information processing method, apparatus, device, storage medium, and computer program product
Technical Field
The present disclosure relates to the field of data and image processing technologies, and in particular, to the field of artificial intelligence technologies such as panoramic image, cloud service, and natural language processing, and more particularly, to an information processing method, apparatus, electronic device, computer readable storage medium, and computer program product.
Background
Currently, the common presentation forms of news media include text, pictures, video, live broadcast and the like, and the news is mostly used for reporting real events with timeliness.
For timeliness and convenient spreading, the mainstream application reports news usually in a mode of mixed arrangement of characters and pictures, wherein the pictures express event related subjects such as event places, characters and the like, and the characters summarize the development venues of the events.
Disclosure of Invention
The embodiment of the disclosure provides an information processing method, an information processing device, electronic equipment, a computer readable storage medium and a computer program product.
In a first aspect, an embodiment of the present disclosure provides an information processing method, including: determining a target position corresponding to the information to be processed according to the content contained in the information to be processed; determining target panoramic content corresponding to the target position; and mounting the target panoramic content into the information to be processed to obtain the processed information.
In a second aspect, an embodiment of the present disclosure proposes an information processing apparatus including: a target position determining unit configured to determine a target position corresponding to the information to be processed according to the content contained in the information to be processed; a panoramic content determination unit configured to determine target panoramic content corresponding to the target location; and the panoramic content mounting unit is configured to mount the target panoramic content into the information to be processed to obtain the processed information.
In a third aspect, an embodiment of the present disclosure provides an electronic device, including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to implement the information processing method as described in any one of the implementations of the first aspect when executed.
In a fourth aspect, embodiments of the present disclosure provide a non-transitory computer-readable storage medium storing computer instructions for enabling a computer to implement an information processing method as described in any one of the implementations of the first aspect when executed.
In a fifth aspect, embodiments of the present disclosure provide a computer program product comprising a computer program which, when executed by a processor, is capable of implementing an information processing method as described in any of the implementations of the first aspect.
According to the information processing method provided by the embodiment of the disclosure, firstly, a target position corresponding to information to be processed is determined according to the content contained in the information to be processed; then, determining target panoramic content corresponding to the target position; and finally, mounting the target panoramic content into the information to be processed to obtain the processed information.
According to the technical scheme, after the target position corresponding to the information to be processed is determined, the matched target panoramic content is determined based on the target position, and finally, the novel processed information of the panoramic content fused with the target position is obtained by mounting the target panoramic content into the information to be processed, so that a technical basis is provided for introducing a virtual display technology, and information viewing experience and substitution feeling of a user are improved.
It should be understood that the description in this section is not intended to identify key or critical features of the embodiments of the disclosure, nor is it intended to be used to limit the scope of the disclosure. Other features of the present disclosure will become apparent from the following specification.
Drawings
Other features, objects and advantages of the present disclosure will become more apparent upon reading of the detailed description of non-limiting embodiments, made with reference to the following drawings:
FIG. 1 is an exemplary system architecture in which the present disclosure may be applied;
FIG. 2 is a flowchart of an information processing method according to an embodiment of the present disclosure;
fig. 3 is a flowchart of a news content display method according to an embodiment of the present disclosure;
FIG. 4 is a flowchart of another information processing method according to an embodiment of the present disclosure;
FIG. 5 is a flowchart of a method for determining panoramic content according to an embodiment of the present disclosure;
fig. 6 is a block diagram of an information processing apparatus according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of an electronic device adapted to perform an information processing method according to an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present disclosure to facilitate understanding, and should be considered as merely exemplary. Accordingly, one of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness. It should be noted that, without conflict, the embodiments of the present disclosure and features of the embodiments may be combined with each other.
In the technical scheme of the disclosure, the acquisition, storage, application and the like of the related personal information of the user accord with the regulations of related laws and regulations, necessary security measures are taken, and the public order harmony is not violated.
FIG. 1 illustrates an exemplary system architecture 100 to which embodiments of the information processing methods, apparatus, electronic devices, and computer-readable storage media of the present disclosure may be applied.
As shown in fig. 1, a system architecture 100 may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used as a medium to provide communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
The user may interact with the server 105 via the network 104 using the terminal devices 101, 102, 103 to receive or send messages or the like. Various applications for implementing information communication between the terminal devices 101, 102, 103 and the server 105, such as an information class application, a map class application, an instant messaging class application, and the like, may be installed on the terminal devices.
The terminal devices 101, 102, 103 and the server 105 may be hardware or software. When the terminal devices 101, 102, 103 are hardware, they may be various electronic devices with display screens, including but not limited to smartphones, tablets, laptop and desktop computers, etc.; when the terminal devices 101, 102, 103 are software, they may be installed in the above-listed electronic devices, which may be implemented as a plurality of software or software modules, or may be implemented as a single software or software module, which is not particularly limited herein. When the server 105 is hardware, it may be implemented as a distributed server cluster formed by a plurality of servers, or may be implemented as a single server; when the server is software, the server may be implemented as a plurality of software or software modules, or may be implemented as a single software or software module, which is not particularly limited herein.
The server 105 can provide various services through various built-in applications, and for example, a counseling-type application that can provide counseling contents including panoramic contents, the server 105 can achieve the following effects when running the counseling-type: firstly, receiving information to be processed (such as news or articles in the form of mixed-line images) in a conventional expression form from terminal devices 101, 102, 103 through a network 104; then, determining a target position corresponding to the information to be processed according to the content contained in the information to be processed; next, determining a target panoramic content corresponding to the target location; next, mounting the target panoramic content into the information to be processed to obtain processed information; finally, the server 105 may replace the processed information with the original information to be processed, and push the processed information with the panoramic content to the corresponding user as push content.
It should be noted that the information to be processed in the conventional expression form may be acquired from the terminal apparatuses 101, 102, 103 through the network 104, may be acquired through other legal information acquisition channels, or may be stored in advance locally in the server 105 in various ways. Thus, when the server 105 detects that such data has been stored locally (e.g., pending information left until processing is initiated), it may choose to retrieve the data directly from the local, in which case the exemplary system architecture 100 may not include the terminal devices 101, 102, 103 and network 104.
Since the panoramic content data amount is large, more storage resources are required, and the recognition and matching of the location information also require a strong computing power, the information processing method provided in the subsequent embodiments of the present disclosure is generally performed by the server 105 storing a large amount of alternative panoramic content data and having a strong computing power, and accordingly, the information processing apparatus is generally also provided in the server 105. It should be noted that, when the terminal devices 101, 102, 103 also have the storage capability and the calculation capability that meet the requirements, the terminal devices 101, 102, 103 may also complete at least one calculation performed by the server 105 through the consultation application installed thereon, so as to output the same final result or intermediate result as the server 105. Accordingly, the information processing apparatus may also be provided in the terminal devices 101, 102, 103. In this case, the exemplary system architecture 100 may also not include the server 105 and the network 104.
It should be understood that the number of terminal devices, networks and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation.
Referring to fig. 2, fig. 2 is a flowchart of an information processing method according to an embodiment of the disclosure, wherein a flowchart 200 includes the following steps:
step 201: determining a target position corresponding to the information to be processed according to the content contained in the information to be processed;
this step aims at determining, by an execution subject of the information processing method (for example, the server 105 shown in fig. 1), a corresponding target position from the content in the information to be processed.
The content contained in the information to be processed can have various representation forms, such as characters, diagrams, schematic diagrams and live-action diagrams, each of which has a mode of representing a certain position, for example, the characters can directly represent a certain position through writing related texts of a certain position, the position which is not directly written can also be determined through meaning expressed by text content, and the schematic diagrams and live-action diagrams can determine a corresponding certain position through direct or implicit relation between displayed image content and the position where the image content is actually displayed. In addition, the real image obtained by shooting by the shooting equipment can also assist in distinguishing the target position by reading some parameters (such as shooting equipment, longitude and latitude at shooting time and the like) of the real image.
In addition, according to different actual demands, a plurality of different positions which can be determined in the content contained in the information to be processed can be all used as target information, or one or a plurality of different positions can be selected as target positions, and the selection criterion can be adaptively adjusted according to the actual demands, so that the method is not particularly limited.
Step 202: determining target panoramic content corresponding to the target position;
on the basis of step 201, this step aims at determining, by the execution subject described above, the target panoramic content that matches the target location. The target panoramic content is generated based on the panoramic image corresponding to the target position, and it should be noted that, because the panoramic image is not recorded at any position in the actual situation, it is difficult to ensure that there is exactly a panoramic image completely matching the target position, and at the same time, the target position points to a larger area, so that a need is created to select a more suitable panoramic image to generate the target panoramic content corresponding to the target position.
Step 203: and mounting the target panoramic content into the information to be processed to obtain the processed information.
On the basis of step 202, this step aims at obtaining the processed information by the execution subject by adopting a mode of mounting the target panoramic content into the information to be processed. The new form information containing the panoramic content matched with the target position corresponding to the content is formed, so that a user viewing the information can simultaneously see the target panoramic content corresponding to the target position, and substitution sense is further improved.
According to the information processing method provided by the embodiment of the disclosure, after the target position corresponding to the information to be processed is determined, the matched target panoramic content is determined based on the target position, and finally, the novel processed information of the panoramic content fused with the target position is obtained by mounting the target panoramic content into the information to be processed, so that a technical basis is provided for introducing a virtual display technology, and the information viewing experience and substitution feeling of a user are improved.
To enhance understanding of the above technical solution, the present embodiment specifically describes the whole solution by specifically combining news consultation information in fig. 3, where the flow 300 includes the following steps:
step 301: determining event occurrence positions corresponding to news events described by the news to be processed according to text contents and/or drawing contents contained in the news to be processed;
this step aims at determining, by the above-mentioned executing body, the news event described by the executing body according to the text content and/or the drawing content contained in the news to be processed (i.e. the news expression form of the conventional through text and/or drawing), and further determining the event occurrence position of the occurred news event.
Step 302: determining target panoramic content corresponding to an event occurrence position;
On the basis of step 301, this step aims at determining, by the above-described execution subject, the target panoramic content corresponding to the event occurrence position, and generally, the panoramic content generated based on the panoramic image of the position closest to the event occurrence position may be directly taken as the target panoramic content without taking other factors into consideration.
Step 303: and hanging the target panoramic content in the news to be processed to obtain the panoramic news.
Based on step 302, this step aims to obtain panoramic news by hanging the target panoramic content of the execution subject in the news to be processed. Namely, panoramic news combining news and panoramic content is obtained by adding target panoramic content, so that substitution feeling of news viewers on news events is improved, and news content expression forms and carriers are enriched.
Referring to fig. 4, fig. 4 is a flowchart of another information processing method according to an embodiment of the disclosure, wherein a flowchart 400 includes the following steps:
step 401: carrying out semantic recognition on text content contained in the information to be processed, and determining a target position;
step 402: determining a target position according to shooting content and/or shooting position parameters of the drawing contained in the to-be-processed processing;
Step 401 and step 402 respectively provide a mode of determining a target position for two content expression forms, and under the condition that the target positions determined by the two modes are the same, the same target position can be used as the basis of the subsequent step; when the target positions determined in the two modes are different, all the target positions can be used as the basis of the subsequent steps, whether some difference degrees are larger or not can be judged, a third party is introduced to assist in judgment under the condition that the difference degrees are larger, and repetition can be considered to be eliminated when the difference degrees are smaller.
In addition, the two modes respectively determine the target position once, and word frequencies of the target position can be accumulated once, so that the importance degree of different target positions is determined according to the statistical mode of TF-IDF (Term Frequency-Inverse Document Frequency, TF is word Frequency and IDF is inverse text Frequency index, and each complete information to be processed can be regarded as a file), and the situation that the position with higher importance degree and lower word Frequency is not used as the target position is avoided.
Step 403: determining a target panoramic recording point according to at least one of the distance from the target position, the change condition of shooting content, the content integrity, the historical shooting times and the latest shooting time;
The step aims at determining a target panoramic recording point matched with the target position by the execution subject in combination with at least one of the distance from the target position, the change condition of shot content, the content integrity, the historical shooting times and the latest shooting time, wherein the panoramic recording point is the position point recorded with the panoramic image.
Step 404: generating target panoramic content according to the panoramic image corresponding to the target panoramic recording point;
on the basis of step 403, this step aims at generating, by the execution subject, the target panoramic content from the panoramic image corresponding to the target panoramic recording point. The target panoramic recording point may record a plurality of panoramic images at a plurality of past time points, and parameters such as time of shooting time points from information to be processed, occurrence time of news events and the like may be combined in the plurality of panoramic images to select.
Step 405: and mounting the target panoramic content into the information to be processed to obtain the processed information.
Based on the process 200, the embodiment provides different target position determining manners for two different information expression forms at the same time through step 401 and step 402, and also provides a specific implementation manner of determining a target panoramic recording point by combining multiple factors and then generating target panoramic content in a panoramic image recorded from the target panoramic recording point through step 403 and step 404, so as to improve the matching degree of the determined target panoramic content and the target position related content appearing in the information to be processed as much as possible.
It should be understood that there is no causal or dependency between the specific implementation provided by steps 401-402 and the specific implementation provided by steps 403-404, and that different individual embodiments may be formed by combining the embodiments provided by the process 200, respectively, and this embodiment exists as only one preferred embodiment that includes both specific implementations.
The present embodiment also provides a specific implementation manner with respect to step 403 and step 404 through fig. 5, wherein the flow 500 includes the following steps:
step 501: determining a panoramic recording point with a distance smaller than a preset distance from a target position as a first recording point;
the present step aims at determining, by the execution subject, first, panorama recording points having a distance from the target position smaller than a preset distance through the preset distance as first recording points, i.e., filtering out part of panorama recording points farther from the target position from all panorama recording points.
Specifically, the preset distance can be set according to the actual situation, and can be dynamically adjusted according to the range indicated by the target position, for example, the range indicated by the target position is large and wide, so that the preset distance can be set to be large and wide, and can be comprehensively adjusted by combining distance limiting conditions possibly existing in the actual application scene.
Step 502: determining a first recording point with the change amplitude of the shooting content along with time being larger than a preset amplitude as a second recording point;
on the basis of step 501, this step aims to determine, by the execution subject, the first recording points whose actual photographed content has a larger change amplitude with time than the preset amplitude as the first recording points, i.e., to filter out the partial panorama recording points whose actual content has a smaller change amplitude from all the first recording points. A small content variation typically means that the content is meaningless, such as a large forest, lawn, or area of long-term unmanned, etc.
Step 503: determining a second recording point with the latest shooting time closest to the event occurrence time in the information to be processed as a target panoramic recording point;
on the basis of step 502, this step aims at determining, by the executing body, a second record point with the latest shooting time closest to the occurrence time of the event in the information to be processed as a target panoramic record point, so as to screen out the panoramic record point of the panoramic content with the most timeliness by the occurrence time of the event.
Step 504: generating a corresponding stereoscopic browsing space according to the structural information of the image content in the panoramic image corresponding to the target panoramic recording point;
The method aims at generating a corresponding stereoscopic browsing space according to the structural information of the image content in the panoramic image corresponding to the target panoramic recording point. The overall spatial structure of the stereoscopic viewing space is restored from the presentation structure of the image content in the panoramic image in order to present to the user a stereoscopic viewing space that is more stereoscopic and more consistent with the real world as viewed by the human eye (because the panoramic image is presented in a flatter manner) without changing the content.
Step 505: placing the image content of the panoramic image into a corresponding part of a stereoscopic browsing space to obtain target panoramic content;
on the basis of step 504, this step aims at placing the image content of the panoramic image into the corresponding part of the stereoscopic browsing space by the execution subject as described above, resulting in the target panoramic content.
Step 506: determining an event associated with the target position according to the information to be processed;
step 507: and adding auxiliary schematic contents corresponding to the event in the target panoramic content.
Because of the aging problem, the panoramic image recorded by the target panoramic recording point often cannot just record the event or content related to the target position in the information to be processed, so the embodiment also provides a scheme of adding auxiliary schematic content corresponding to the event in the stereoscopic target panoramic content through steps 506-507, so as to further improve the substitution sense of the user and the information acquisition efficiency.
Based on the flow 400, the embodiment not only specifically provides a screening scheme which is sequentially executed in three steps to select a more suitable target panoramic recording point through the steps 501-503, but also provides a target panoramic content generation mode for constructing a stereoscopic browsing space based on panoramic images and filling corresponding contents through the steps 504-505, so as to further promote substitution feeling when a user views; meanwhile, on the basis of the steps 504-505, a supplementary technical scheme of newly adding auxiliary schematic contents corresponding to the event corresponding to the information to be processed in the stereoscopic browsing space is provided through the steps 506-507, so that the substitution sense of a user and the information acquisition efficiency are further improved.
It should be understood that, the specific implementation manner provided in the steps 501-503 and the specific implementation manner provided in the steps 504-505 do not have causal and dependency relationships, and different individual embodiments may be formed by combining the embodiments provided in the flow 400, and the steps 506-507 may be implemented as a new embodiment by directly using panoramic images as the implementation manner of the target panoramic content while being based on the target panoramic content formation manner provided in the steps 504-505, which is just one preferred embodiment.
In order to deepen understanding, the present disclosure further provides a specific implementation scheme in combination with a specific application scenario for constructing panoramic news, and the main steps are as follows:
1) The Internet news content is acquired through capturing, in-situ interview or historical data mining, the content is not limited to current news, but can also be historical data, geographical encyclopedias and the like;
2) Preprocessing the captured news content to produce information labels in a uniform format, such as types, sources, time, places, subjects, authority, heat and the like;
3) Extracting keywords, keyword frequency, weight, semantic features and other information related to the occurrence position of the content by adopting a natural language understanding technology and combining map big data such as POI (Point of Interest, interest point) data, road data and the like;
4) Predicting the news occurrence position according to the information, iteratively adjusting a position prediction model, and outputting accurate position information with the accuracy rate and recall rate meeting expectations (the position prediction model constructed in the step is obtained by training based on training samples with the corresponding relation indeed, such as the monument-B position of a fighter with the sacrifice in the A battle);
5) Hitching position information predicted based on news content and map data (POI, road, etc.), for example, C label can be related to E area F of D city;
6) Judging whether panoramic hooking is needed for preliminary filtering according to the associated map data attributes such as types (buildings, mountains, cells, roads, business circles, villages and the like), indexing panoramic image data according to the position attributes, and possibly associating a plurality of panoramic images with one news;
7) Producing multidimensional features for subsequent evaluation of hooking quality according to the news data, panorama image information (richness, brightness, image semantic information), panorama space information (coordinates, orientation, etc.), other information (such as acquisition time, acquisition weather, acquisition season), and the like;
8) Marking the characteristics produced in the steps through marking objects, training a production ordering model based on the panoramic images added with the marked marks by adopting machine learning, and selecting the best panoramic image or images for a certain news;
9) And the news is displayed at the product end by fusing the news with the optimal panorama, wherein the form comprises displaying the news in the panorama or supplementing the panorama entry in the news.
With further reference to fig. 6, as an implementation of the method shown in the foregoing figures, the present disclosure provides an embodiment of an information processing apparatus, which corresponds to the method embodiment shown in fig. 2, and which is particularly applicable to various electronic devices.
As shown in fig. 6, the information processing apparatus 600 of the present embodiment may include: a target position determination unit 601, a panoramic content determination unit 602, and a panoramic content mounting unit 603. Wherein, the target position determining unit 601 is configured to determine a target position corresponding to the information to be processed according to the content contained in the information to be processed; a panoramic content determination unit 602 configured to determine target panoramic content corresponding to a target location; the panorama content mounting unit 603 is configured to mount the target panorama content into the information to be processed, to obtain the processed information.
In the present embodiment, in the information processing apparatus 600: the specific processing of the target position determining unit 601, the panoramic content determining unit 602, and the panoramic content mounting unit 603 and the technical effects thereof may refer to the relevant descriptions of steps 201 to 203 in the corresponding embodiment of fig. 2, and are not repeated herein.
In some optional implementations of the present embodiment, the target location determining unit 601 may include:
the text content semantic recognition subunit is configured to perform semantic recognition on text content contained in the information to be processed and determine a target position;
and/or
And the drawing content and parameter identification subunit is configured to determine the target position according to the shooting content and/or shooting position parameters of the drawing contained in the processing to be processed.
In some optional implementations of the present embodiment, the panorama content determining unit 602 may include:
a target recording point determining subunit configured to determine a target panoramic recording point according to at least one of a distance from a target position, a change condition of photographed content, content integrity, a number of times of historical photographing, and a latest photographing time;
and the target panoramic content generation subunit is configured to generate target panoramic content according to the panoramic image corresponding to the target panoramic recording point.
In some optional implementations of the present embodiment, the target record point determination subunit may be further configured to:
determining a panoramic recording point with a distance smaller than a preset distance from a target position as a first recording point;
determining a first recording point with the change amplitude of the shooting content along with time being larger than a preset amplitude as a second recording point;
and determining a second recording point with the latest shooting time closest to the event occurrence time in the information to be processed as a target panoramic recording point.
In some optional implementations of the present embodiment, the target panoramic content generation subunit may be further configured to:
generating a corresponding stereoscopic browsing space according to the structural information of the image content in the panoramic image corresponding to the target panoramic recording point;
And placing the image content of the panoramic image into a corresponding part of the stereoscopic browsing space to obtain target panoramic content.
In some optional implementations of the present embodiment, the information processing apparatus 600 may further include:
an associated event determining unit configured to determine an event associated with the target location according to the information to be processed after the target panoramic content is generated;
and an auxiliary caption content adding unit configured to add auxiliary caption content corresponding to the event to the target panorama content.
In some optional implementations of the present embodiment, the target location determination unit 601 may be further configured to:
determining event occurrence positions corresponding to news events described by the news to be processed according to text contents and/or drawing contents contained in the news to be processed;
correspondingly, the panoramic content determination unit 602 may be further configured to:
determining target panoramic content corresponding to an event occurrence position;
correspondingly, the panoramic content mounting unit 603 may be further configured to:
and mounting the target panoramic content into the news to be processed to obtain the panoramic news.
The information processing device provided by the embodiment determines the matched target panoramic content based on the target position after determining the target position corresponding to the information to be processed, and finally obtains new processed information of the panoramic content fused with the target position by mounting the target panoramic content into the information to be processed, thereby providing a technical basis for introducing a virtual display technology and being beneficial to improving the information viewing experience and substitution feeling of a user.
According to an embodiment of the present disclosure, the present disclosure further provides an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; the memory stores instructions executable by the at least one processor to enable the at least one processor to implement the information processing method described in any of the embodiments above when executed.
According to an embodiment of the present disclosure, there is also provided a readable storage medium storing computer instructions for enabling a computer to implement the information processing method described in any of the above embodiments when executed.
According to an embodiment of the present disclosure, the present disclosure further provides a computer program product capable of implementing the information processing method described in any of the above embodiments when being executed by a processor.
Fig. 7 illustrates a schematic block diagram of an example electronic device 700 that may be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular telephones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be exemplary only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 7, the apparatus 700 includes a computing unit 701 that can perform various appropriate actions and processes according to a computer program stored in a Read Only Memory (ROM) 702 or a computer program loaded from a storage unit 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 may also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.
Various components in device 700 are connected to I/O interface 705, including: an input unit 706 such as a keyboard, a mouse, etc.; an output unit 707 such as various types of displays, speakers, and the like; a storage unit 708 such as a magnetic disk, an optical disk, or the like; and a communication unit 709 such as a network card, modem, wireless communication transceiver, etc. The communication unit 709 allows the device 700 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
The computing unit 701 may be a variety of general and/or special purpose processing components having processing and computing capabilities. Some examples of computing unit 701 include, but are not limited to, a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), various specialized Artificial Intelligence (AI) computing chips, various computing units running machine learning model algorithms, a Digital Signal Processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 701 performs the respective methods and processes described above, for example, an information processing method. For example, in some embodiments, the information processing method may be implemented as a computer software program tangibly embodied on a machine-readable medium, such as storage unit 708. In some embodiments, part or all of the computer program may be loaded and/or installed onto device 700 via ROM 702 and/or communication unit 709. When a computer program is loaded into the RAM 703 and executed by the computing unit 701, one or more steps of the information processing method described above may be performed. Alternatively, in other embodiments, the computing unit 701 may be configured to perform the information processing method by any other suitable means (e.g. by means of firmware).
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuit systems, field Programmable Gate Arrays (FPGAs), application Specific Integrated Circuits (ASICs), application Specific Standard Products (ASSPs), systems On Chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs, the one or more computer programs may be executed and/or interpreted on a programmable system including at least one programmable processor, which may be a special purpose or general-purpose programmable processor, that may receive data and instructions from, and transmit data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for carrying out methods of the present disclosure may be written in any combination of one or more programming languages. These program code may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus such that the program code, when executed by the processor or controller, causes the functions/operations specified in the flowchart and/or block diagram to be implemented. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. The machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and pointing device (e.g., a mouse or trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic input, speech input, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a background component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such background, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), wide Area Networks (WANs), and the internet.
The computer system may include a client and a server. The client and server are typically remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so as to solve the defects of large management difficulty and weak service expansibility in the traditional physical host and virtual private server (VPS, virtual Private Server) service.
According to the technical scheme of the embodiment of the disclosure, after the target position corresponding to the information to be processed is determined, the matched target panoramic content is determined based on the target position, and finally, the novel processed information of the panoramic content fused with the target position is obtained by mounting the target panoramic content into the information to be processed, so that a technical basis is provided for introducing a virtual display technology, and information viewing experience and substitution feeling of a user are improved.
It should be appreciated that various forms of the flows shown above may be used to reorder, add, or delete steps. For example, the steps recited in the present disclosure may be performed in parallel or sequentially or in a different order, provided that the desired results of the technical solutions of the present disclosure are achieved, and are not limited herein.
The above detailed description should not be taken as limiting the scope of the present disclosure. It will be apparent to those skilled in the art that various modifications, combinations, sub-combinations and alternatives are possible, depending on design requirements and other factors. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present disclosure are intended to be included within the scope of the present disclosure.

Claims (12)

1. An information processing method, comprising:
determining a target position corresponding to the information to be processed according to the content contained in the information to be processed;
determining a target panoramic recording point according to at least one of the distance from the target position, the change condition of shooting content, the content integrity, the historical shooting times and the latest shooting time; generating target panoramic content according to the panoramic image corresponding to the target panoramic recording point;
mounting the target panoramic content into the information to be processed to obtain processed information;
wherein, the determining the target panoramic recording point according to at least one of the distance from the target position, the change condition of the shot content, the content integrity, the historical shooting times and the latest shooting time comprises:
determining a panoramic recording point with a distance smaller than a preset distance from the target position as a first recording point; determining a first recording point with the change amplitude of the shooting content along with time being larger than a preset amplitude as a second recording point; and determining a second recording point with the latest shooting time closest to the event occurrence time in the information to be processed as the target panoramic recording point.
2. The method of claim 1, wherein the determining, according to content included in the information to be processed, a target location corresponding to the information to be processed includes:
Carrying out semantic recognition on text content contained in the information to be processed, and determining the target position;
and/or
And determining the target position according to the shooting content and/or shooting position parameters of the drawing contained in the to-be-processed processing.
3. The method of claim 1, wherein the generating the target panoramic content from the panoramic image corresponding to the target panoramic recording point comprises:
generating a corresponding stereoscopic browsing space according to the structural information of the image content in the panoramic image;
and placing the image content of the panoramic image into a corresponding part of the stereoscopic browsing space to obtain the target panoramic content.
4. The method of any of claims 1-3, wherein after generating the target panoramic content, further comprising:
determining an event associated with the target position according to the information to be processed;
and adding auxiliary schematic content corresponding to the event in the target panoramic content.
5. The method of claim 1, wherein the determining, according to content included in the information to be processed, a target location corresponding to the information to be processed includes:
determining an event occurrence position corresponding to a news event described by the news to be processed according to text content and/or drawing content contained in the news to be processed;
Correspondingly, the determining the target panoramic content corresponding to the target position includes:
determining target panoramic content corresponding to the event occurrence position;
correspondingly, the mounting the target panoramic content into the information to be processed to obtain processed information includes:
and hanging the target panoramic content in the news to be processed to obtain panoramic news.
6. An information processing apparatus comprising:
a target position determining unit configured to determine a target position corresponding to information to be processed according to content contained in the information to be processed;
a panorama content determining unit comprising: a target recording point determining subunit configured to determine a target panoramic recording point according to at least one of a distance from the target location, a change condition of photographed content, content integrity, a number of historical photographing times, and a latest photographing time; a target panoramic content generation subunit configured to generate the target panoramic content according to a panoramic image corresponding to the target panoramic recording point;
the panoramic content mounting unit is configured to mount the target panoramic content into the information to be processed to obtain processed information;
Wherein the target record point determination subunit is further configured to:
determining a panoramic recording point with a distance smaller than a preset distance from the target position as a first recording point;
determining a first recording point with the change amplitude of the shooting content along with time being larger than a preset amplitude as a second recording point;
and determining a second recording point with the latest shooting time closest to the event occurrence time in the information to be processed as the target panoramic recording point.
7. The apparatus of claim 6, wherein the target location determination unit comprises:
a text content semantic recognition subunit configured to perform semantic recognition on text content contained in the information to be processed, and determine the target position;
and/or
And the drawing content and parameter identification subunit is configured to determine the target position according to the shooting content and/or shooting position parameters of the drawing contained in the to-be-processed processing.
8. The apparatus of claim 6, wherein the target panoramic content generation subunit is further configured to:
generating a corresponding stereoscopic browsing space according to the structural information of the image content in the panoramic image;
and placing the image content of the panoramic image into a corresponding part of the stereoscopic browsing space to obtain the target panoramic content.
9. The apparatus of any of claims 6-8, further comprising:
an associated event determining unit configured to determine an event associated with the target location according to the information to be processed after the target panoramic content is generated;
an auxiliary content adding unit configured to add auxiliary content corresponding to the event to the target panoramic content.
10. The apparatus of claim 6, wherein the target location determination unit is further configured to:
determining an event occurrence position corresponding to a news event described by the news to be processed according to text content and/or drawing content contained in the news to be processed;
correspondingly, the panoramic content determination unit is further configured to:
determining target panoramic content corresponding to the event occurrence position;
correspondingly, the panoramic content mounting unit is further configured to:
and mounting the target panoramic content into the news to be processed to obtain panoramic news.
11. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the information processing method of any one of claims 1-5.
12. A non-transitory computer-readable storage medium storing computer instructions for causing the computer to execute the information processing method of any one of claims 1-5.
CN202110693412.8A 2021-06-22 2021-06-22 Information processing method, apparatus, device, storage medium, and computer program product Active CN113360797B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110693412.8A CN113360797B (en) 2021-06-22 2021-06-22 Information processing method, apparatus, device, storage medium, and computer program product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110693412.8A CN113360797B (en) 2021-06-22 2021-06-22 Information processing method, apparatus, device, storage medium, and computer program product

Publications (2)

Publication Number Publication Date
CN113360797A CN113360797A (en) 2021-09-07
CN113360797B true CN113360797B (en) 2023-12-15

Family

ID=77535721

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110693412.8A Active CN113360797B (en) 2021-06-22 2021-06-22 Information processing method, apparatus, device, storage medium, and computer program product

Country Status (1)

Country Link
CN (1) CN113360797B (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108989681A (en) * 2018-08-03 2018-12-11 北京微播视界科技有限公司 Panorama image generation method and device
CN109743584A (en) * 2018-11-13 2019-05-10 百度在线网络技术(北京)有限公司 Panoramic video synthetic method, server, terminal device and storage medium
CN110321048A (en) * 2018-03-30 2019-10-11 阿里巴巴集团控股有限公司 The processing of three-dimensional panorama scene information, exchange method and device
CN111368114A (en) * 2018-12-25 2020-07-03 腾讯科技(深圳)有限公司 Information display method, device, equipment and storage medium
CN112100418A (en) * 2020-09-11 2020-12-18 北京百度网讯科技有限公司 Method and device for inquiring historical street view, electronic equipment and storage medium
CN112218099A (en) * 2020-08-28 2021-01-12 新奥特(北京)视频技术有限公司 Panoramic video generation method, panoramic video playing method, panoramic video generation device, and panoramic video generation system
CN112492230A (en) * 2020-11-26 2021-03-12 北京字跳网络技术有限公司 Video processing method and device, readable medium and electronic equipment
CN112559884A (en) * 2020-12-25 2021-03-26 北京百度网讯科技有限公司 Method and device for hooking panorama and interest point, electronic equipment and storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9317133B2 (en) * 2010-10-08 2016-04-19 Nokia Technologies Oy Method and apparatus for generating augmented reality content
KR101583286B1 (en) * 2014-05-16 2016-01-07 네이버 주식회사 Method, system and recording medium for providing augmented reality service and file distribution system
CN108205797B (en) * 2016-12-16 2021-05-11 杭州海康威视数字技术股份有限公司 Panoramic video fusion method and device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110321048A (en) * 2018-03-30 2019-10-11 阿里巴巴集团控股有限公司 The processing of three-dimensional panorama scene information, exchange method and device
CN108989681A (en) * 2018-08-03 2018-12-11 北京微播视界科技有限公司 Panorama image generation method and device
CN109743584A (en) * 2018-11-13 2019-05-10 百度在线网络技术(北京)有限公司 Panoramic video synthetic method, server, terminal device and storage medium
CN111368114A (en) * 2018-12-25 2020-07-03 腾讯科技(深圳)有限公司 Information display method, device, equipment and storage medium
CN112218099A (en) * 2020-08-28 2021-01-12 新奥特(北京)视频技术有限公司 Panoramic video generation method, panoramic video playing method, panoramic video generation device, and panoramic video generation system
CN112100418A (en) * 2020-09-11 2020-12-18 北京百度网讯科技有限公司 Method and device for inquiring historical street view, electronic equipment and storage medium
CN112492230A (en) * 2020-11-26 2021-03-12 北京字跳网络技术有限公司 Video processing method and device, readable medium and electronic equipment
CN112559884A (en) * 2020-12-25 2021-03-26 北京百度网讯科技有限公司 Method and device for hooking panorama and interest point, electronic equipment and storage medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
全景图增强地理现实的空间认知问题;贾奋励;陈令羽;宋国民;张世团;;测绘工程(第04期);全文 *
基于地理信息的电力线全景图像信息融合方法;宋海华;韩军;邵志一;;电网技术(第07期);全文 *

Also Published As

Publication number Publication date
CN113360797A (en) 2021-09-07

Similar Documents

Publication Publication Date Title
US11747960B2 (en) Efficiently augmenting images with related content
CN112954450B (en) Video processing method and device, electronic equipment and storage medium
US9165206B2 (en) Updating point of interest data based on an image
WO2020233166A1 (en) Comment data provision and display method, apparatus, electronic device, and storage medium
CN113079417B (en) Method, device and equipment for generating bullet screen and storage medium
CN109255037B (en) Method and apparatus for outputting information
US10061761B2 (en) Real-time dynamic visual aid implementation based on context obtained from heterogeneous sources
US10116668B2 (en) System and method for enhanced display-screen security and privacy
CN112818224B (en) Information recommendation method and device, electronic equipment and readable storage medium
CN111309200B (en) Method, device, equipment and storage medium for determining extended reading content
CN109815448B (en) Slide generation method and device
WO2021238084A1 (en) Voice packet recommendation method, apparatus and device, and storage medium
CN112287168A (en) Method and apparatus for generating video
US11048387B1 (en) Systems and methods for managing media feed timelines
CN112052911A (en) Method and device for identifying riot and terrorist content in image, electronic equipment and storage medium
CN115080816A (en) Method, device, equipment and medium for generating summary information and displaying search result
CN114461920A (en) Data processing method, device, medium and equipment for list information recommendation
US20210271725A1 (en) Systems and methods for managing media feed timelines
US10038937B2 (en) Location-specific audio capture and correspondence to a video file
CN113360797B (en) Information processing method, apparatus, device, storage medium, and computer program product
CN111626922A (en) Picture generation method and device, electronic equipment and computer readable storage medium
CN113873323B (en) Video playing method, device, electronic equipment and medium
CN113343133B (en) Display page generation method, related device and computer program product
CN113194265B (en) Streetscape video generation method and device, electronic equipment and storage medium
CN111652831B (en) Object fusion method and device, computer-readable storage medium and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant