WO2019128568A1 - Procédé, appareil et dispositif de poussée de contenu - Google Patents

Procédé, appareil et dispositif de poussée de contenu Download PDF

Info

Publication number
WO2019128568A1
WO2019128568A1 PCT/CN2018/116918 CN2018116918W WO2019128568A1 WO 2019128568 A1 WO2019128568 A1 WO 2019128568A1 CN 2018116918 W CN2018116918 W CN 2018116918W WO 2019128568 A1 WO2019128568 A1 WO 2019128568A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
scene
acquisition request
terminal
push
Prior art date
Application number
PCT/CN2018/116918
Other languages
English (en)
Chinese (zh)
Inventor
陈岩
刘耀勇
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2019128568A1 publication Critical patent/WO2019128568A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/50—Network services
    • H04L67/55—Push-based network services
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80—Camera processing pipelines; Components thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/95—Computational photography systems, e.g. light-field imaging systems
    • H04N23/958—Computational photography systems, e.g. light-field imaging systems for extended depth of field imaging
    • H04N23/959—Computational photography systems, e.g. light-field imaging systems for extended depth of field imaging by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/12—Messaging; Mailboxes; Announcements

Definitions

  • the embodiments of the present invention relate to the field of Internet technologies, and in particular, to a content pushing method, apparatus, and device.
  • CP Content Provider
  • contents such as news news, hot news, anecdotes and other things to the user.
  • the content pushing method provided by the related art is as follows: the server that establishes a communication connection with the terminal stores the browsing record of the user, and the browsing record includes the content browsed by the user, and when the subsequent server performs the content pushing, the content and the content that the user browsed are calculated first. The degree of relevance between the pushed content, and then the content that is more relevant to the content viewed by the user is pushed to the terminal.
  • the embodiment of the present application provides a content pushing method, device, and device.
  • the technical solution is as follows:
  • the embodiment of the present application provides a content push method, where the method is applied to a terminal, and the method includes:
  • the embodiment of the present application provides a content pushing method, where the method is applied to a server, and the method includes:
  • the embodiment of the present application provides a content pushing device, where the device is applied to a terminal, and the device includes:
  • a picture extraction module configured to extract a picture collected by the camera during shooting by the camera
  • a scene determining module configured to determine, according to the picture, a scene currently located
  • a request sending module configured to send a content acquisition request to the server, where the content acquisition request carries scenario information for indicating the scenario;
  • the content receiving module is configured to receive the push content related to the scenario sent by the server.
  • the embodiment of the present application provides a content pushing device, where the device is applied to a server, and the device includes:
  • a request receiving module configured to receive a content acquisition request sent by the terminal, where the content acquisition request carries scenario information, where the scenario information is used to indicate a scenario where the terminal is currently located, and the scenario is performed by the terminal according to the camera. The picture extracted during the shooting process is determined;
  • a content obtaining module configured to acquire, according to the content obtaining request, push content related to the scene
  • a content sending module configured to send the pushed content to the terminal.
  • an embodiment of the present application provides a terminal, where the terminal includes a processor and a memory, where the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement, as described in one aspect, Content push method.
  • an embodiment of the present application provides a server, where the terminal includes a processor and a memory, where the memory stores at least one instruction, and the instruction is loaded and executed by the processor to implement Content push method.
  • an embodiment of the present application provides a computer readable storage medium, where the computer readable storage medium stores at least one instruction that is loaded and executed by a processor to implement content push as described in one aspect. method.
  • an embodiment of the present application provides a computer readable storage medium, where the computer readable storage medium stores at least one instruction that is loaded and executed by a processor to implement content as described in another aspect. Push method.
  • FIG. 1 is a schematic diagram of an application scenario provided by an exemplary embodiment of the present application
  • FIG. 2 is a flowchart of a content push method on a terminal side according to an exemplary embodiment of the present application
  • FIG. 3 is a flowchart of a server-side content push method provided by an exemplary embodiment of the present application.
  • FIG. 4 is a flowchart of a content pushing method provided by an exemplary embodiment of the present application.
  • FIG. 5 is a flowchart of a content pushing method provided by another exemplary embodiment of the present application.
  • FIG. 6 is a block diagram of a content pushing apparatus provided by an exemplary embodiment of the present application.
  • FIG. 7 is a block diagram of a content pushing apparatus according to another exemplary embodiment of the present application.
  • FIG. 8 is a structural block diagram of a terminal provided by an exemplary embodiment of the present application.
  • FIG. 9 is a structural block diagram of a server provided by another exemplary embodiment of the present application.
  • FIG. 1 shows a schematic diagram of an application scenario shown by an exemplary embodiment of the present application.
  • the application scenario includes: the terminal 10 and the server 20.
  • the terminal 10 is equipped with a camera and has a photographing function.
  • the terminal 10 can be an electronic device such as a mobile phone, a tablet computer, an e-book reader, a multimedia playing device, and a wearable device.
  • the server 20 is for providing push content to the terminal 10.
  • the push content may be in the form of a text, a picture, an audio, a video, etc., and the push content may be various content such as information news, hot news, anecdotes, anecdotes, and the like.
  • the server 20 may be a server provided by a content provider, or may be a background server corresponding to a third-party application, and the background server may interface with servers of a plurality of different content providers to obtain push content from servers of different content providers.
  • the server 20 can be a server, a server cluster composed of several servers, or a cloud computing service center.
  • the server 20 has a communication connection with the terminal 10, which may be a wireless network connection.
  • FIG. 2 shows a flowchart of a content pushing method provided by an exemplary embodiment of the present application.
  • the method is applicable to the terminal 10 in the implementation environment shown in FIG.
  • the method can include the following steps:
  • step 201 during the shooting by the camera, the picture captured by the camera is extracted.
  • the terminal is equipped with a camera, and the camera can be disposed on the front panel or the back panel of the terminal, which is not limited in this embodiment of the present application.
  • the terminal can take photos or videos through the camera.
  • the picture extracted by the terminal is the photo; if the terminal is capturing the video through the camera, the picture extracted by the terminal may be one or more image frames in the video.
  • the terminal extracts the image captured by the camera every preset time to implement extracting multiple image frames from the video. Extracting multiple image frames from the video can make the identified scene more accurate on the one hand; on the other hand, it can detect in real time whether the scene in which the user is located changes, and when the subsequent server pushes the content, the pushed content is more targeted. Sex.
  • Step 202 Determine a current scene according to the picture.
  • the picture taken by the camera of the terminal can usually reflect the scene where the user is currently located.
  • the picture is an environment picture, and the environment included in the picture content can reflect the current scene of the user.
  • the picture is a self-portrait picture, and the picture content includes background information such as the environment in which the user is photographed, and the background content may reflect the current scene of the user.
  • step 202 is specifically implemented by: identifying a picture by using a scene recognition model, and determining the identified scene as the current scene.
  • the scene recognition model is obtained by training a Convolutional Neural Network (CNN) using a sample picture with a scene label.
  • CNN Convolutional Neural Network
  • the scene recognition model includes: an input layer, at least one convolution layer (eg, including a first convolutional layer, a second convolutional layer, and a third convolutional layer, a total of three convolutional layers) At least one fully connected layer (such as a total of two fully connected layers including a first fully connected layer and a second fully connected layer) and an output layer.
  • the input data of the input layer is the picture captured by the camera, and the output result of the output layer is the scene corresponding to the picture.
  • the scene recognition process is as follows: inputting the image captured by the camera to the input layer of the scene recognition model, extracting the feature of the image by the convolution layer of the scene recognition model, and then combining and abstracting the above features by the fully connected layer of the scene recognition model, The data suitable for the classification of the output layer is obtained, and finally the output layer outputs the scene corresponding to the picture.
  • the specific structure of the convolutional layer and the fully connected layer of the scene recognition model is not limited.
  • the scene recognition model shown in the above embodiment is merely exemplary and explanatory, and is not intended to limit the present disclosure.
  • the more layers of the convolutional neural network the better the effect but the longer the calculation time.
  • the convolutional neural network with the appropriate number of layers can be designed in combination with the requirements for recognition accuracy and efficiency.
  • the sample picture refers to a pre-selected picture used to train the CNN.
  • the sample picture has a scene label, and the scene label of the sample picture is usually determined manually, and is used to describe the scene corresponding to the sample picture.
  • the scene label may be a beach, a shopping mall, a restaurant, an amusement park, a museum, etc., which is not limited by the embodiment of the present application.
  • the CNN may adopt an alexNet network, a VGG-16 network, a GoogleNet network, a Deep Residual Learning network, or the like, which is not limited in this embodiment of the present application.
  • the algorithm used in the training of the CNN to obtain the scene recognition model may be a BP (Back-Propagation), a Fast RCNN (Regions with Convolutional Neural Network) algorithm, etc. This is not limited.
  • the following algorithm is used to train the CNN to obtain the scene recognition model.
  • the BP algorithm is taken as an example to explain the training process of the scene recognition model: firstly, the parameters of each layer in the CNN are randomly set. Secondly, the sample picture is input into the CNN to obtain the scene recognition result. Then, the scene recognition result is compared with the scene label of the sample picture to obtain an error between the scene recognition result and the scene label; finally, the parameters of each layer in the CNN are adjusted based on the above error, and the above steps are repeated until the scene recognition result and the scene are determined. The error between the tags is less than the preset value, and the scene recognition model is obtained.
  • Step 203 Send a content acquisition request to the server.
  • a content acquisition request is used to request that the push content be obtained from the server.
  • the content acquisition request carries scenario information for indicating the above scenario.
  • the scenario information may be an identifier of the scenario, and the identifier of the scenario is used to uniquely indicate the scenario, and different scenarios have different identifiers.
  • the identifier of the scene may be a character string formed by any one or more combinations of numbers, letters, and symbols.
  • the content acquisition request further carries an identifier of the terminal, where the identifier of the terminal is used to uniquely indicate the terminal, and different terminals have different identifiers.
  • the identifier of the terminal may be a user account that is logged in the terminal, or an IP (Internet Protocol) address of the terminal, or other unique identifier.
  • the terminal may send a content acquisition request to the server after the shooting ends. In the above manner, it is possible to prevent the push content from occluding the shooting interface.
  • Step 204 Receive push content related to the scene sent by the server.
  • the server After receiving the content acquisition request sent by the terminal, the server acquires the push content related to the scenario indicated by the scenario information according to the scenario information carried in the content acquisition request. Then, the server sends the above-mentioned push content related to the scene to the terminal, and accordingly, the terminal receives the push content related to the scene sent by the server. In some embodiments of the present application, after the terminal receives the push content related to the scene, the push content is displayed for the user to consult.
  • the method provided by the embodiment of the present invention extracts a picture collected by a camera during shooting by a camera, and determines a current scene of the user based on the picture, and the server pushes the terminal to the current location of the user.
  • the context-related push content makes the push content have a strong correlation with the current scene of the user, so the push content is more targeted and more in line with the user's current actual demand for the push content.
  • the terminal identifies the scene in which the user is currently located by means of a photo or video taken by the user, thereby implementing scene acquisition without the user's perception, and avoiding additional operations.
  • the method before the sending the content acquisition request to the server, the method further includes:
  • Obtaining content requirement information where the content requirement information is used to indicate a type of the push content that is required, and the content acquisition request further carries the content requirement information;
  • Receiving, by the server, the push content related to the scenario including:
  • the method before the sending the content acquisition request to the server, the method further includes:
  • the step of transmitting the content acquisition request to the server is performed.
  • the content acquisition request further carries a timestamp, where the timestamp is used to indicate an acquisition time of the picture.
  • FIG. 3 shows a flowchart of a content pushing method provided by another exemplary embodiment of the present application.
  • the method is applicable to the server 20 in the implementation environment shown in FIG.
  • the method can include the following steps:
  • Step 301 Receive a content acquisition request sent by the terminal.
  • a content acquisition request is used to request to obtain push content.
  • the content acquisition request carries the scene information, where the scene information is used to indicate the current scene of the terminal, and the scene is determined by the terminal according to the picture extracted during the shooting process by the camera.
  • the manner in which the terminal determines the scenario has been described in the foregoing embodiment of FIG. 2, and details are not described herein again.
  • the content acquisition request further carries an identifier of the terminal.
  • Step 302 Acquire a push content related to the scene according to the content acquisition request.
  • the server stores a preset correspondence, where the preset correspondence includes a correspondence between the scene and the pushed content.
  • the server After receiving the content acquisition request, the server searches for the corresponding relationship based on the scenario indicated by the scenario information carried in the content acquisition request, obtains the push content corresponding to the scenario, and uses the push content as the push content related to the scenario.
  • the terminal identifies the picture A collected by the camera, and the scene of the picture A is a subway station.
  • the terminal sends a content acquisition request carrying the scene information and the identifier of the terminal to the server, and the server searches for the corresponding relationship to obtain a correspondence with the subway station.
  • the push content is a small fun event in the subway, the server gets the subway fun, and sends the above push content to the terminal.
  • the server may select, in the push content, the push content whose release time is shorter than the preset time interval, or may select the push content that reaches the preset amount of the push content.
  • the preset duration and the preset number may be set according to actual requirements, which is not limited in this embodiment of the present application.
  • Step 303 Send the push content to the terminal.
  • the terminal receives the push content sent by the server.
  • the method provided by the embodiment of the present invention extracts a picture collected by a camera during shooting by a camera, and determines a current scene of the user based on the picture, and the server pushes the terminal to the current location of the user.
  • the context-related push content makes the push content have a strong correlation with the current scene of the user, so the push content is more targeted and more in line with the user's current actual demand for the push content.
  • the terminal identifies the scene in which the user is currently located by means of a photo or video taken by the user, thereby implementing scene acquisition without the user's perception, and avoiding additional operations.
  • the content obtaining request further carries content requirement information, where the content requirement information is used to indicate a type of push content required by the terminal;
  • the obtaining the push content related to the scenario according to the content obtaining request includes:
  • the content acquisition request further carries a timestamp, where the timestamp is used to indicate an acquisition time of the picture;
  • the method further includes:
  • Detecting whether another content acquisition request sent by the terminal is received before receiving the content acquisition request, and the another content acquisition request carries the same scene information, and the another content acquisition request is The time interval between the carried timestamp and the timestamp is less than a preset duration;
  • FIG. 4 shows a flowchart of a content pushing method provided by another exemplary embodiment of the present application.
  • the method can be applied to the implementation environment shown in FIG. 1, and the method can include the following steps:
  • Step 401 The terminal extracts a picture collected by the camera during the shooting by the camera.
  • Step 402 The terminal uses the scene recognition model to identify the image, and determines the identified scene as the current scene.
  • Step 403 The terminal acquires content requirement information.
  • the content requirement information is used to indicate the type of push content required.
  • the type of the push content includes a movie, a music, an encyclopedia, a news, a shopping, and the like, which is not limited in the embodiment of the present application.
  • the terminal detects whether a specified event is received, and if the specified event is received, the terminal acquires content requirement information according to the specified event.
  • the specified event is that the application in the terminal is triggered to run within a preset time after the image is collected.
  • the preset time can be set according to actual requirements. This embodiment does not limit this. For example, the preset time is 30. minute.
  • the terminal saves a first correspondence between the type of the application and the type of the pushed content.
  • the first correspondence may refer to Table-2.
  • Type of application Type of push content Play class application Film and television Music app Music class News application News class Shopping application Shopping class Browser class application Encyclopedia
  • the terminal When detecting the specified event, the terminal acquires the type of the application that is triggered to run, and searches for the first correspondence relationship to obtain the type of the push content corresponding to the type of the application. For example, the application "XX News" in the terminal is triggered to run, and the terminal acquires the type of "XX News” as a news application, and the content requirement information is used to indicate that the type of the push content required is also a news category.
  • the terminal detects whether the specified keyword is included in the collected voice information, and if so, obtains the content requirement information according to the specified keyword.
  • the terminal stores a second correspondence between the specified keyword and the type of the pushed content, and the terminal collects the voice information while capturing the video, and identifies the voice information, if the specified keyword is identified, Then, the second correspondence is searched for, and the type of the push content corresponding to the specified keyword is obtained.
  • the terminal recognizes the designated keyword “song”, and then searches for the second correspondence to obtain the type of the push content required to be a music class.
  • the voice information is “Where to start shopping”, and the terminal recognizes the designated keyword “walking”, and then searches for the second correspondence to obtain the type of push content required for the shopping category.
  • step 403 is not limited in the embodiment of the present application, and may be performed before step 401, may be performed after step 402, or may be performed simultaneously with step 401 or step 402.
  • Step 404 The terminal detects whether the scene is identified from other pictures within a preset duration.
  • the user may take multiple pictures in the same scene. If the content acquisition request is sent every time the current scene is identified, the terminal may receive a large amount of repeated push content in a short time, which affects the user experience. Therefore, in some embodiments of the present application, before transmitting the content acquisition request, the terminal first detects whether the scene is identified from other pictures within a preset duration.
  • the preset duration can be set according to actual experience, which is not limited in this embodiment of the present application. Illustratively, the preset duration is 5 hours.
  • the terminal saves a third correspondence between a picture captured by the camera, a scene in which the picture is collected, and a time at which the picture is collected. After identifying the current scene, the terminal detects whether the current corresponding scene is included in the third correspondence, and if not, whether the terminal is not in other pictures within the preset duration. Identifying the foregoing scenario, if yes, detecting whether the minimum time interval between the time when the picture is captured and the current time corresponding to the scenario in the first correspondence relationship reaches a preset duration, if not, the terminal is not in the preset Whether the above scene is recognized from other pictures within the duration, if so, the terminal recognizes the scene from other pictures within a preset duration.
  • Step 405 If the scene is not recognized from other pictures within the preset duration, the terminal sends a content acquisition request to the server.
  • the content acquisition request is used to request to obtain the push content related to the scene and conforming to the type.
  • the content acquisition request carries scenario information, content requirement information, and an identifier of the terminal for indicating a scenario.
  • the step of transmitting a content acquisition request to the server is not performed. For example, if the preset time is 5 hours, if the terminal recognizes that the scenes in which two pictures are collected are all beaches within 5 hours, the terminal does not send a content acquisition request to the server.
  • the server receives the content acquisition request sent by the terminal.
  • Step 406 The server acquires, according to the content acquisition request, the push content that is related to the scene and matches the type.
  • the server determines the push content from two scenarios in which the user is currently located, and the type of the push content required, so that the push content currently accepted by the terminal is more targeted and more in line with the actual situation of the user. demand.
  • the type of push content required is music
  • the server pushes a list of songs suitable for listening to the holiday to the terminal.
  • the scene in which the picture is collected is a shopping mall
  • the type of the push content required is a shopping category
  • the server pushes the shop information and the preferential information near the shopping mall to the terminal.
  • the scene in which the picture is collected is a museum
  • the type of push content required is an encyclopedia
  • the server pushes the science information of the museum to the terminal.
  • step 407 the server sends the push content to the terminal.
  • the terminal receives the push content sent by the server.
  • the method provided by the embodiment of the present application further determines the push content by using the server from the current situation of the user and the type of the push content, so that the push content received by the terminal is more targeted. Sex, more in line with the actual needs of users.
  • the terminal first detects whether the same scene is identified within the preset duration, and then determines whether to send the content acquisition request, thereby preventing the terminal from receiving a large amount of repeated push content in a short time, and additionally, the terminal does not need to After the current scene is identified, the content acquisition request is sent to the server, so the number of interactions between the terminal and the server can be reduced, and the communication resources of the terminal are saved.
  • FIG. 5 shows a flowchart of a content pushing method provided by another exemplary embodiment of the present application.
  • the method can be applied to the implementation environment shown in FIG. 1, and the method can include the following steps:
  • Step 501 The terminal extracts a picture collected by the camera during the shooting by the camera.
  • Step 502 The terminal uses the scene recognition model to identify the image, and determines the identified scene as the current scene.
  • Step 503 The terminal acquires content requirement information.
  • the content requirement information is used to indicate the type of push content required.
  • Step 504 The terminal sends a content acquisition request to the server.
  • the content acquisition request carries scenario information, content requirement information, and a timestamp for indicating a scenario.
  • the timestamp is used to indicate the acquisition time of the picture.
  • the server receives the content acquisition request sent by the terminal.
  • Step 505 The server detects whether another content acquisition request sent by the terminal is received before receiving the content acquisition request, and another content acquisition request carries the same scenario information, and the timestamp and time carried in another content acquisition request The time interval between stamps is less than the preset duration.
  • the server detects whether another content acquisition request is received, and then determines whether to return the pushed content to the terminal, thereby preventing the terminal from receiving a large amount of repeated push content in a short time when the terminal is in the same scene. .
  • the server maintains a fourth correspondence between the identity of the terminal, the scene information, and the timestamp. After receiving the content acquisition request, the server queries the fourth correspondence, and determines whether the scenario information corresponding to the terminal includes the scenario information carried in the content requirement information. If not, the server does not receive another content acquisition request, if not included. And detecting whether the minimum time interval between the timestamp corresponding to the scenario information and the timestamp carried in the content requirement information reaches a preset duration. If not, the server does not receive another content acquisition request, and if yes, The server receives another content acquisition request.
  • Step 506 If another content acquisition request is not received, the server acquires the push content related to the scene and conforms to the type according to the content acquisition request.
  • the server does not perform the step of acquiring the push content related to the scene and conforming to the type according to the content acquisition request.
  • step 507 the server sends the push content to the terminal.
  • the terminal receives the push content sent by the server.
  • the method provided by the embodiment of the present application determines whether to acquire content related to the scene by detecting whether the device receives another content acquisition request within a preset time period before receiving the content acquisition request, thereby preventing the terminal from being A large amount of repeated push content is received in a short time.
  • the step on the terminal side can be separately implemented as the content push method on the terminal side
  • the step on the server side can be separately implemented as the content push method on the server side
  • FIG. 6 shows a block diagram of a content pushing apparatus provided by an exemplary embodiment of the present application.
  • the content pushing device has a function of implementing the above-described terminal side method example, and the function may be implemented by hardware or may be implemented by hardware by executing corresponding software.
  • the content pushing device includes: a picture extracting module 601, a scene determining module 602, a request sending module 603, and a content receiving module 604.
  • the image extraction module 601 is configured to extract a picture collected by the camera during shooting by the camera.
  • the scene determining module 602 is configured to determine a current scene according to the picture.
  • the request sending module 603 is configured to send a content acquisition request to the server, where the content acquisition request carries scenario information for indicating the scenario.
  • the content receiving module 604 is configured to receive the push content related to the scenario sent by the server.
  • the scene determining module 602 is configured to identify the image by using a scene recognition model, and determine the identified scene as the current scene, where The scene recognition model is obtained by training a CNN with a sample picture having a scene label.
  • the apparatus further includes: an information acquisition module (not shown).
  • the information obtaining module is configured to obtain content requirement information, where the content requirement information is used to indicate a type of the pushed content, and the content obtaining request further carries the content requirement information.
  • the content receiving module 604 is configured to receive the push content that is sent by the server and is related to the scenario and matches the type.
  • the apparatus further includes: a scene detection module (not shown).
  • the scene detection module is configured to detect whether the scene is recognized from other pictures within a preset duration.
  • the request sending module 603 is configured to perform the step of sending a content acquisition request to the server if the scene is not recognized from other pictures within the preset duration.
  • the content acquisition request further carries a timestamp, where the timestamp is used to indicate an acquisition time of the picture.
  • the device extracts a picture collected by the camera during the shooting process by the camera, determines a current scene of the user based on the picture, and pushes the terminal to the terminal and the current location of the user.
  • the context-related push content makes the push content have a strong correlation with the current scene of the user, so the push content is more targeted and more in line with the user's current actual demand for the push content.
  • the terminal identifies the scene in which the user is currently located by means of a photo or video taken by the user, thereby implementing scene acquisition without the user's perception, and avoiding additional operations.
  • FIG. 7 shows a block diagram of a content pushing apparatus provided by another exemplary embodiment of the present application.
  • the content push device has a function of implementing the above-described server side method example, and the function may be implemented by hardware or may be implemented by hardware.
  • the content pushing device includes a request receiving module 701, a content obtaining module 702, and a content sending module 703.
  • the request receiving module 701 is configured to receive a content acquisition request sent by the terminal, where the content acquisition request carries scenario information, where the scenario information is used to indicate a scenario where the terminal is currently located, and the scenario is determined by the terminal according to the camera. The picture extracted during the shooting process is determined.
  • the content obtaining module 702 is configured to acquire the push content related to the scene according to the content acquisition request.
  • the content sending module 703 is configured to send the pushed content to the terminal.
  • the content acquisition request further carries content requirement information, where the content requirement information is used to indicate a type of push content required by the terminal;
  • the content obtaining module 702 is configured to acquire, according to the content acquisition request, push content that is related to the scene and matches the type.
  • the content acquisition request further carries a timestamp, where the timestamp is used to indicate an acquisition time of the picture; the apparatus further includes: requesting Detection module (not shown).
  • a request detection module configured to detect whether another content acquisition request sent by the terminal is received before receiving the content acquisition request, and the another content acquisition request carries the same scene information, and the The time interval between the timestamp carried in the other content acquisition request and the timestamp is less than a preset duration.
  • the content obtaining module 702 is configured to perform the step of acquiring the push content related to the scene according to the content acquisition request, if the another content acquisition request is not received.
  • the device extracts a picture collected by the camera during the shooting process by the camera, determines a current scene of the user based on the picture, and pushes the terminal to the terminal and the current location of the user.
  • the context-related push content makes the push content have a strong correlation with the current scene of the user, so the push content is more targeted and more in line with the user's current actual demand for the push content.
  • the terminal identifies the scene in which the user is currently located by means of a photo or video taken by the user, thereby implementing scene acquisition without the user's perception, and avoiding additional operations.
  • FIG. 8 is a structural block diagram of a terminal 800 provided by an exemplary embodiment of the present application.
  • the terminal 800 can be an electronic device such as a mobile phone, a tablet computer, an e-book reader, a multimedia playing device, and a wearable device.
  • the terminal 800 includes a processor 801, a memory 802, a radio frequency circuit 804, and a camera component 806.
  • Processor 801 can include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like.
  • the processor 801 can be implemented by at least one of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). achieve.
  • the processor 801 may also include a main processor and a coprocessor.
  • the main processor is a processor for processing data in an awake state, which is also called a CPU (Central Processing Unit); the coprocessor is A low-power processor for processing data in standby.
  • the processor 801 can be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and rendering of the content that the display needs to display.
  • the processor 801 may also include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.
  • AI Artificial Intelligence
  • the processor 801 executes the program instructions in the memory 802, the content push method of the terminal side provided by the foregoing various method embodiments is implemented.
  • Memory 802 can include one or more computer readable storage media, which can be non-transitory. Memory 802 can also include high speed random access memory, as well as non-volatile memory, such as one or more disk storage devices, flash memory devices. In some embodiments, the non-transitory computer readable storage medium in the memory 802 is configured to store at least one instruction for execution by the processor 801 to implement the content push provided by the method embodiment of the present application. method.
  • the radio frequency circuit 804 is configured to receive and transmit an RF (Radio Frequency) signal, also called an electromagnetic signal. Radio frequency circuit 804 communicates with the communication network and other communication devices via electromagnetic signals. The radio frequency circuit 804 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 804 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and the like. The radio frequency circuit 804 can communicate with other terminals via at least one wireless communication protocol.
  • RF Radio Frequency
  • the wireless communication protocols include, but are not limited to, the World Wide Web, a metropolitan area network, an intranet, generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity) networks.
  • the radio frequency circuit 804 may also include a circuit related to NFC (Near Field Communication), which is not limited in this application.
  • Camera component 806 is used to capture images or video.
  • camera assembly 806 includes a front camera and a rear camera.
  • the front camera is placed on the front panel of the terminal, and the rear camera is placed on the back of the terminal.
  • the rear camera is at least two, which are respectively a main camera, a depth camera, a wide-angle camera, and a telephoto camera, so as to realize the background blur function of the main camera and the depth camera, and the main camera Combine with a wide-angle camera for panoramic shooting and VR (Virtual Reality) shooting or other integrated shooting functions.
  • camera assembly 806 can also include a flash.
  • the flash can be a monochrome temperature flash or a two-color temperature flash.
  • the two-color temperature flash is a combination of a warm flash and a cool flash that can be used for light compensation at different color temperatures.
  • the terminal 800 also optionally includes a peripheral device interface 803.
  • the RF circuit 804 and camera assembly 806 can be connected to the peripheral device interface 803 as a peripheral device via a bus, signal line or circuit board.
  • the processor 801, the memory 802, and the peripheral device interface 803 can be connected by a bus or a signal line.
  • Peripheral device interface 803 can be used to connect at least one peripheral device associated with I/O (Input/Output) to processor 801 and memory 802.
  • processor 801, memory 802, and peripheral interface 803 are integrated on the same chip or circuit board; in some other embodiments, any of processor 801, memory 802, and peripheral interface 803 or The two can be implemented on a separate chip or circuit board, which is not limited in this embodiment.
  • the terminal 800 optionally further includes: at least one peripheral device.
  • Each peripheral device can be connected to the peripheral device interface 803 via a bus, signal line or circuit board.
  • the peripheral device includes at least one of a display screen 805 and a power source 809.
  • the display screen 805 is used to display a UI (User Interface).
  • the UI can include graphics, text, icons, video, and any combination thereof.
  • display 805 is a touch display
  • display 805 also has the ability to capture touch signals over the surface or surface of display 805.
  • the touch signal can be input to the processor 801 for processing as a control signal.
  • the display screen 805 can also be used to provide virtual buttons and/or virtual keyboards, also referred to as soft buttons and/or soft keyboards.
  • the display screen 805 may be one, and the front panel of the terminal 800 is disposed; in other embodiments, the display screen 805 may be at least two, respectively disposed on different surfaces of the terminal 800 or in a folded design; In still other embodiments, the display screen 805 can be a flexible display screen disposed on a curved surface or a folded surface of the terminal 800. Even the display screen 805 can be set to a non-rectangular irregular pattern, that is, a profiled screen.
  • the display screen 805 can be prepared by using an LCD (Liquid Crystal Display) or an OLED (Organic Light-Emitting Diode).
  • Power source 809 is used to power various components in terminal 800.
  • the power source 809 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery.
  • the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery.
  • a wired rechargeable battery is a battery that is charged by a wired line
  • a wireless rechargeable battery is a battery that is charged by a wireless coil.
  • the rechargeable battery can also be used to support fast charging technology.
  • FIG. 8 does not constitute a limitation to the terminal 800, and may include more or less components than those illustrated, or may combine some components or adopt different component arrangements.
  • FIG. 9 is a schematic structural diagram of a server provided by an embodiment of the present application. This server is used to implement the content push method on the server side in the above embodiment. Specifically:
  • the server 900 includes a central processing unit (CPU) 901, a system memory 904 including a random access memory (RAM) 902 and a read only memory (ROM) 903, and a system bus 905 that connects the system memory 904 and the central processing unit 901.
  • the server 900 also includes a basic input/output system (I/O system) 906 that facilitates transfer of information between various devices within the computer, and mass storage for storing the operating system 913, applications 914, and other program modules 915.
  • I/O system basic input/output system
  • the basic input/output system 909 includes a display 908 for displaying information and an input device 909 such as a mouse, a keyboard for inputting information by a user. Both the display 908 and the input device 909 are connected to the central processing unit 901 via an input and output controller 910 that is coupled to the system bus 905.
  • the basic input/output system 906 can also include an input output controller 910 for receiving and processing input from a plurality of other devices, such as a keyboard, mouse, or electronic stylus. Similarly, input and output controller 910 also provides output to a display screen, printer, or other type of output device.
  • the mass storage device 907 is connected to the central processing unit 901 by a mass storage controller (not shown) connected to the system bus 905.
  • the mass storage device 907 and its associated computer readable medium provide non-volatile storage for the server 900. That is, the mass storage device 907 can include a computer readable medium (not shown) such as a hard disk or a CD-ROM drive.
  • the computer readable medium can include computer storage media and communication media.
  • Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
  • Computer storage media include RAM, ROM, EPROM, EEPROM, flash memory or other solid state storage technologies, CD-ROM, DVD or other optical storage, magnetic tape cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices.
  • RAM random access memory
  • ROM read only memory
  • EPROM Erasable programmable read-only memory
  • EEPROM electrically erasable programmable read-only memory
  • the server 900 may also be operated by a remote computer connected to the network through a network such as the Internet. That is, the server 900 can be connected to the network 912 through a network interface unit 911 connected to the system bus 905, or can also be connected to other types of networks or remote computer systems (not shown) using the network interface unit 911. .
  • the memory also includes one or more programs, the one or more programs being stored in a memory and configured to be executed by one or more processors.
  • the one or more programs described above include instructions for executing the content push method on the server side described above.
  • a computer readable storage medium having stored therein at least one instruction loaded by a processor of a terminal and executed to implement the method described above The content push method on the terminal side in the example.
  • a computer readable storage medium having stored therein at least one instruction loaded by a processor of a server and executed to implement the method described above The content push method on the server side in the example.
  • the computer readable storage medium described above may be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device.
  • a computer program product for implementing a content push method on a terminal side in the above method embodiment when the computer program product is executed by a processor in the terminal.
  • a computer program product for implementing a server-side content push method in the above method embodiment when the computer program product is executed by a processor in the server.
  • a plurality as referred to herein means two or more.
  • "and/or” describing the association relationship of the associated objects, indicating that there may be three relationships, for example, A and/or B, which may indicate that there are three cases where A exists separately, A and B exist at the same time, and B exists separately.
  • the character “/” generally indicates that the contextual object is an “or” relationship.
  • the words “first,” “second,” and similar terms used herein do not denote any order, quantity, or importance, but are used to distinguish different components.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computing Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

La présente invention concerne un procédé, un appareil et un dispositif de poussée de contenu. Le procédé est appliqué à un terminal et le procédé comprend : l'extraction d'une image collectée par une caméra pendant le processus de photographie par l'intermédiaire de la caméra ; la détermination d'une scène en cours en fonction de l'image ; l'envoi d'une demande d'acquisition de contenu à un serveur, la demande d'acquisition de contenu portant des informations de scène permettant d'indiquer une scène ; et la réception d'un contenu poussé relatif à une scène envoyé par le serveur. Selon le mode de réalisation de la présente invention, le contenu poussé envoyé, par un serveur, à un terminal présente une forte corrélation avec une scène dans laquelle un utilisateur est actuellement situé, et ainsi, le contenu poussé est plus ciblé et mieux aligné avec les demandes réelles en cours de l'utilisateur du contenu poussé. De plus, un terminal identifie et détermine la scène dans laquelle un utilisateur est actuellement situé au moyen d'une photographie ou d'une séquence vidéo prise par l'utilisateur, ce qui permet de mettre en œuvre une acquisition de scène sans la perception de l'utilisateur, et d'éviter ainsi des opérations supplémentaires.
PCT/CN2018/116918 2017-12-27 2018-11-22 Procédé, appareil et dispositif de poussée de contenu WO2019128568A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201711442084.4 2017-12-27
CN201711442084.4A CN109981695B (zh) 2017-12-27 2017-12-27 内容推送方法、装置及设备

Publications (1)

Publication Number Publication Date
WO2019128568A1 true WO2019128568A1 (fr) 2019-07-04

Family

ID=67066430

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/116918 WO2019128568A1 (fr) 2017-12-27 2018-11-22 Procédé, appareil et dispositif de poussée de contenu

Country Status (2)

Country Link
CN (1) CN109981695B (fr)
WO (1) WO2019128568A1 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110673732A (zh) * 2019-09-27 2020-01-10 深圳市商汤科技有限公司 场景共享方法及装置、系统、电子设备和存储介质
CN111460294A (zh) * 2020-03-31 2020-07-28 汉海信息技术(上海)有限公司 消息推送方法、装置、计算机设备及存储介质
CN111597369A (zh) * 2020-05-18 2020-08-28 Oppo广东移动通信有限公司 照片查看方法、装置、存储介质及终端
CN111768235A (zh) * 2020-06-29 2020-10-13 京东数字科技控股有限公司 监播方法、装置、设备以及存储介质
CN111953767A (zh) * 2020-08-07 2020-11-17 北京三快在线科技有限公司 内容分享的方法、装置、设备及存储介质
CN112364219A (zh) * 2020-10-26 2021-02-12 北京五八信息技术有限公司 内容发布方法、装置、电子设备及存储介质
CN112698848A (zh) * 2020-12-31 2021-04-23 Oppo广东移动通信有限公司 机器学习模型的下载方法、装置、终端及存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111753193A (zh) * 2020-06-15 2020-10-09 Oppo广东移动通信有限公司 应用推送方法、装置、移动终端及存储介质
CN116401401A (zh) * 2023-05-26 2023-07-07 深圳市致尚信息技术有限公司 智能k歌系统基于用户喜好的歌曲推荐方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140143351A1 (en) * 2012-11-20 2014-05-22 Peter Xiu Deng Ambient-Location-Push Notification
CN105956091A (zh) * 2016-04-29 2016-09-21 北京小米移动软件有限公司 扩展信息获取方法及装置
CN106878355A (zh) * 2015-12-11 2017-06-20 腾讯科技（深圳）有限公司 一种信息推荐方法和装置
CN107025251A (zh) * 2016-07-29 2017-08-08 杭州网易云音乐科技有限公司 一种数据推送方法及装置

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102724276B (zh) * 2012-05-03 2016-06-15 Tcl集团股份有限公司 一种基于android系统的信息推送方法及系统
CN102957742A (zh) * 2012-10-18 2013-03-06 北京天宇朗通通信设备股份有限公司 数据推送方法及装置
CN103399860A (zh) * 2013-07-04 2013-11-20 北京百纳威尔科技有限公司 内容显示方法和装置
CN104618446A (zh) * 2014-12-31 2015-05-13 百度在线网络技术（北京）有限公司 一种实现多媒体推送的方法和装置
GB2534849A (en) * 2015-01-28 2016-08-10 Canon Kk Client-driven push of resources by a server device
CN105095399B (zh) * 2015-07-06 2019-06-28 百度在线网络技术（北京）有限公司 搜索结果推送方法及装置
CN105488112B (zh) * 2015-11-20 2019-09-17 小米科技有限责任公司 信息推送方法及装置
CN105760508A (zh) * 2016-02-23 2016-07-13 北京搜狗科技发展有限公司 一种信息推送方法、装置及电子设备
CN106202484A (zh) * 2016-07-18 2016-12-07 浪潮电子信息产业股份有限公司 一种推荐浏览信息的方法及一种客户端
CN106569676B (zh) * 2016-11-15 2019-12-03 网易乐得科技有限公司 一种信息推荐方法和装置
CN107194318B (zh) * 2017-04-24 2020-06-12 北京航空航天大学 目标检测辅助的场景识别方法
CN108520448B (zh) * 2018-03-07 2022-05-17 创新先进技术有限公司 事件管理方法及装置

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140143351A1 (en) * 2012-11-20 2014-05-22 Peter Xiu Deng Ambient-Location-Push Notification
CN106878355A (zh) * 2015-12-11 2017-06-20 腾讯科技（深圳）有限公司 一种信息推荐方法和装置
CN105956091A (zh) * 2016-04-29 2016-09-21 北京小米移动软件有限公司 扩展信息获取方法及装置
CN107025251A (zh) * 2016-07-29 2017-08-08 杭州网易云音乐科技有限公司 一种数据推送方法及装置

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110673732A (zh) * 2019-09-27 2020-01-10 深圳市商汤科技有限公司 场景共享方法及装置、系统、电子设备和存储介质
CN111460294A (zh) * 2020-03-31 2020-07-28 汉海信息技术(上海)有限公司 消息推送方法、装置、计算机设备及存储介质
CN111460294B (zh) * 2020-03-31 2023-09-15 汉海信息技术(上海)有限公司 消息推送方法、装置、计算机设备及存储介质
CN111597369A (zh) * 2020-05-18 2020-08-28 Oppo广东移动通信有限公司 照片查看方法、装置、存储介质及终端
CN111768235A (zh) * 2020-06-29 2020-10-13 京东数字科技控股有限公司 监播方法、装置、设备以及存储介质
CN111953767A (zh) * 2020-08-07 2020-11-17 北京三快在线科技有限公司 内容分享的方法、装置、设备及存储介质
CN111953767B (zh) * 2020-08-07 2022-11-29 北京三快在线科技有限公司 内容分享的方法、装置、设备及存储介质
CN112364219A (zh) * 2020-10-26 2021-02-12 北京五八信息技术有限公司 内容发布方法、装置、电子设备及存储介质
CN112698848A (zh) * 2020-12-31 2021-04-23 Oppo广东移动通信有限公司 机器学习模型的下载方法、装置、终端及存储介质

Also Published As

Publication number Publication date
CN109981695B (zh) 2021-03-26
CN109981695A (zh) 2019-07-05

Similar Documents

Publication Publication Date Title
WO2019128568A1 (fr) Procédé, appareil et dispositif de poussée de contenu
US10068130B2 (en) Methods and devices for querying and obtaining user identification
WO2020125660A1 (fr) Procédé de recommandation d'informations, appareil et dispositif, et support de stockage
CN111858971B (zh) 多媒体资源推荐方法、装置、终端及服务器
US20150026209A1 (en) Method And Terminal For Associating Information
EP4391486A2 (fr) Galerie de messages avec un intérêt partagé
WO2020044097A1 (fr) Procédé et appareil destinés à mettre en œuvre un service en fonction d'un emplacement
RU2640632C2 (ru) Способ и устройство для доставки информации
WO2016100342A1 (fr) Galerie de vidéos définie par rapport à une ligne de temps audio
US11895567B2 (en) Lending of local processing capability between connected terminals
CN108717432B (zh) 资源查询方法及装置
US20230122838A1 (en) Data Sharing Method, Electronic Device, and System
TW201508520A (zh) 設置背景圖像的方法及相關的伺服器和系統
WO2012158323A1 (fr) Procédé et appareil pour activer des étiquettes virtuelles
CN108897996B (zh) 标识信息关联方法及装置、电子设备及存储介质
JP7231638B2 (ja) 映像に基づく情報取得方法及び装置
CN105979363A (zh) 一种身份识别法和装置
CN103167258A (zh) 用于选择图像捕获装置上捕获的图像的方法、系统和设备
CN111435377A (zh) 应用推荐方法、装置、电子设备以及存储介质
CN113987326B (zh) 资源推荐方法、装置、计算机设备及介质
US20220215050A1 (en) Picture Search Method and Device
CN110929159A (zh) 资源投放方法、装置、设备及介质
CN110929137A (zh) 文章推荐方法、装置、设备及存储介质
KR101659420B1 (ko) 공유 비디오 장치 및 개인용 장치를 이용한 개인맞춤화된 비디오 콘텐츠 소비
CN113918661A (zh) 知识图谱生成方法、装置和电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18895246

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18895246

Country of ref document: EP

Kind code of ref document: A1