CN114120211B - Message pushing method and device and storage medium - Google Patents

Message pushing method and device and storage medium Download PDF

Info

Publication number
CN114120211B
CN114120211B CN202210112107.XA CN202210112107A CN114120211B CN 114120211 B CN114120211 B CN 114120211B CN 202210112107 A CN202210112107 A CN 202210112107A CN 114120211 B CN114120211 B CN 114120211B
Authority
CN
China
Prior art keywords
video
application
electronic device
preset
subtitle
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210112107.XA
Other languages
Chinese (zh)
Other versions
CN114120211A (en
Inventor
李懿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honor Device Co Ltd
Original Assignee
Honor Device Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Honor Device Co Ltd filed Critical Honor Device Co Ltd
Priority to CN202210112107.XA priority Critical patent/CN114120211B/en
Publication of CN114120211A publication Critical patent/CN114120211A/en
Application granted granted Critical
Publication of CN114120211B publication Critical patent/CN114120211B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content

Abstract

The embodiment of the application provides a message pushing method, a message pushing device and a storage medium, which relate to the technical field of terminals, and the method comprises the following steps: the electronic equipment plays a first video by running a video application; the electronic equipment acquires user behavior data; the user behavior data comprises a first frequency and a second frequency; and under the condition that the first frequency is greater than a first threshold value and the second frequency is less than a second threshold value, the electronic equipment displays a first notification message, wherein the first notification message is used for prompting the user to: and displaying the subtitles meeting the preset rule by using the subtitle function when the second video is played by using the preset application, wherein the second video is the same as or different from the first video, so that the electronic equipment displays the subtitle function push information according to the user behavior data, a method for opening the subtitle function is provided for the user, and the electronic equipment can supplement the information conveyed by the audio corresponding to the video watched by the user by displaying the subtitles. Thereby improving the user experience.

Description

Message pushing method and device and storage medium
Technical Field
The present application relates to the field of terminal technologies, and in particular, to a method and an apparatus for pushing a message, and a storage medium.
Background
With the development of mobile internet technology, video applications are increasing, and the video applications provide convenience for life, entertainment, learning and work of people.
Currently, users watch videos using video applications in a wider and wider range of scenes. However, in some usage scenarios, the video played by the electronic device cannot meet the user's expectations.
For example, a video played by the electronic device is not in a language familiar to the user, or in a public place, when the user is not convenient to listen to a usage scene such as an audio of the played video without an earphone, the user needs to search for video resources again or give up watching the video temporarily, which brings a bad user experience to the user.
Disclosure of Invention
The embodiment of the application provides a message pushing method, a message pushing device and a storage medium, which relate to the technical field of terminals. The user experience is improved.
In a first aspect, an embodiment of the present application provides a message pushing method, where the method includes: the electronic equipment plays a first video by running a video application; the video application belongs to a preset application; the electronic equipment acquires user behavior data; the user behavior data comprises a first frequency and a second frequency; the first frequency is the frequency of using a preset application by the target account; the second frequency is the frequency of using the subtitle function by the target account; in the case that the first frequency is greater than the first threshold and the second frequency is less than the second threshold (for example, the second threshold is 1), the electronic device displays a first notification message, where the first notification message is used to prompt the user to: and displaying the subtitles meeting the preset rule by using a subtitle function when the second video is played by using the preset application, wherein the second video is the same as or different from the first video.
The target account may be an account bound with the electronic device, or the target account may also be an account bound with the video application, which is not limited in this embodiment of the application. The preset application is a preset video application, may be preset in the electronic device, and may be updated in the process of system upgrade of the electronic device. The preset application may also be user-set in a white list. The electronic equipment receives an operation of modifying the white list by a user and updates the preset application in response to the operation. The subtitle function may be used to display corresponding subtitles as the video is played by the electronic device interface. Illustratively, the subtitle function may be an Artificial Intelligence (AI) subtitle.
In the embodiment of the application, the electronic device can display the caption function push information (such as the first notification message) according to the user behavior data, and provide a method for opening the caption function for the user, so that the electronic device can respond to the user operation to display the caption to supplement the information conveyed by the audio corresponding to the video watched by the user. Thereby improving the user experience.
In a possible implementation manner, the displaying, by the electronic device, the first notification message includes: the electronic equipment displays a first notification message in a preset display form; the preset display form comprises the following steps: any one of a banner display, a notification center display, or a dialog display. Therefore, the banner display and the dialog box display can timely enable the user to know the first notification message. The notification center display may not disturb the user from viewing the first video.
In a possible implementation manner, the electronic device displays the first notification message in a preset display form, including: the method comprises the steps that when the electronic equipment opens a first video through a video application, the electronic equipment displays a first notification message in a preset display form; or, the electronic device displays the first notification message in a preset display form in the process of playing the first video through the video application; or, the electronic device displays the first notification message in a preset display form when the electronic device exits the video application. The electronic equipment displays the first notification message in the process of playing the first video, so that a user can acquire the subtitle function through the first notification message in time to display the subtitle meeting the preset rule under the condition that the first video does not include the subtitle meeting the preset rule. The electronic equipment displays the first notification message under the condition of exiting the video application, on one hand, the user cannot be disturbed to watch the first video, on the other hand, the first notification message is also pushed to the user, and the user can open the subtitle function under the condition of needing.
In a possible implementation, the method further includes: the electronic equipment acquires a subtitle detection result of the first video; the above-mentioned electronic equipment obtains user behavior data, including: and when the caption detection result represents that the first video does not comprise the caption, or when the caption detection result represents that the caption included in the first video does not meet the preset rule, the electronic equipment acquires the user behavior data. In this way, when the first video does not include the subtitles or the subtitles included in the first video do not meet the preset rule, the user may have a potential need of a subtitle function, and the user behavior data is acquired at this time, which is helpful for reducing the load of the electronic device.
In a possible implementation, the electronic device includes a machine playing skill; the game skill includes an operation method using a caption function; the first notification message includes: prompt information and a skip control related to the subtitle function; the method further comprises the following steps: the electronic equipment receives a first trigger operation of a user for the jump control, and jumps to an operation method using a subtitle function in a machine playing skill in response to the first trigger operation. Thus, the user can know the subtitle function by jumping to the operation method of using the subtitle function in the machine playing skill and use the subtitle function when needed. The user experience is improved.
In a possible implementation manner, the first notification message includes: prompt information and control related to the subtitle function; the method further comprises the following steps: and the electronic equipment receives a second trigger operation of the user for the control, and responds to the second trigger operation, and displays the subtitles meeting the preset rule by using the subtitle function when the second video is played through the video application. Therefore, under the condition that the first notification message comprises the control, the user can open the subtitle function through the control, the user runs the preset application again to play the video, and under the condition that the video does not comprise the subtitle meeting the preset rule, the electronic equipment can display the subtitle meeting the preset rule to make up the information transmitted by the video and the audio, so that the user experience is improved.
In a possible implementation, the method further includes: when the second frequency is greater than the second threshold, the electronic device determines that the second video does not include the subtitles or the subtitles included in the second video do not meet a preset rule when playing the second video through a preset application; and the electronic equipment displays the subtitles meeting the preset rule by using the subtitle function when playing the second video through the preset application. In this way, without user intervention, the electronic device displays the subtitles meeting the preset rules according to the fact that the number of times the subtitle function is used by the user is greater than the second threshold. The fact that the subtitle function is larger than the second threshold value shows that the possibility that the user uses the subtitle function is higher, so that the higher probability that the subtitles meeting the preset rule are displayed can meet the requirements of the user, and the satisfaction degree of the user is improved.
In a possible implementation manner, a computing engine and a sensing service are operated in the electronic device; registering a video playing event of a preset application in a sensing service; when the electronic device plays the second video through the preset application, it is determined that the second video does not include the subtitles, or the subtitles included in the second video do not satisfy the preset rule, including: under the condition that the sensing service monitors that the preset application plays the second video, the calculation engine performs subtitle detection on the second video through a subtitle detection algorithm; under the condition that the calculation engine cannot detect the subtitles within the first preset time period, the calculation engine determines that the second video does not include the subtitles; under the condition that the calculation engine detects the subtitles of the second video within a first preset time period, the calculation engine identifies the language of the subtitles, and under the condition that the language of the subtitles is the first language and the system language of the electronic equipment acquired by the calculation engine is the second language, the calculation engine determines that the subtitles included in the second video do not meet preset rules. Thus, the system language is generally a language known to the user, and in the case where the caption language is different from the system language, the caption language does not satisfy the preset rule more probably.
In a possible implementation manner, the acquiring, by the electronic device, the user behavior data includes: the electronic equipment sends a first request message to the big data image platform; the first request message includes an identification of the target account; the first request message is used for acquiring user behavior data of the target account; the electronic equipment receives the user behavior data sent by the big data image platform. Therefore, the user behavior data acquired by the electronic equipment from the big data image platform is more comprehensive, and the acquired user behavior data not only comprises the user behavior data recorded by the electronic equipment, but also comprises the user behavior data recorded by other electronic equipment with the same account as the electronic equipment. Therefore, when the electronic equipment pushes the first notification message according to the user behavior data, the user requirements are more likely to be met.
In a possible implementation, the method further includes: under the condition that the electronic equipment monitors that the video application is opened, the electronic equipment sends a record of using the video application to the big data image platform; the record includes an identification of the target account; and recording user behavior data for updating the target account of the big data representation platform. Therefore, the record of the video application used by the user can be reported to the big data image platform in time, and the user behavior data acquired by the electronic equipment is more accurate.
In a possible implementation mode, a computing engine, an intelligent reminder and a notification bar are operated in the electronic equipment; the electronic equipment displays a first notification message in a preset display form, and the method comprises the following steps: the calculation engine sends a push indication message to the intelligent reminder; the intelligent reminder sends a recommendation notification to the notification bar according to the push indication message; the notification bar pushes a first notification message. Therefore, the electronic equipment divides the labor of displaying the first notification message through the calculation engine, the intelligent reminding and the notification bar respectively, and therefore the coupling degree of the codes is reduced.
In a possible implementation mode, a computing engine, an intelligent reminder and an artificial intelligent subtitle application are operated in the electronic equipment; the electronic device displays a first notification message in a preset display form, and the method includes: the calculation engine sends a push indication message to the intelligent reminder; the intelligent reminder sends a recommendation notification to the artificial intelligent subtitle application according to the push indication message; the artificial intelligence subtitle application displays a first notification message through a dialog box. Therefore, the electronic equipment divides the labor of displaying the first notification message through the calculation engine, the intelligent reminding and the notification bar respectively, and therefore the coupling degree of the codes is reduced.
In a second aspect, an embodiment of the present application provides an electronic device, which includes a processing module and a display module; the processing module is used for: playing a first video through a video application; the video application belongs to a preset application; acquiring user behavior data; the user behavior data comprises a first frequency and a second frequency; the first frequency is the frequency of using a preset application by the target account; the second frequency is the frequency of using the subtitle function by the target account; the display module is used for: and displaying a first notification message under the condition that the first frequency is greater than a first threshold value and the second frequency is less than a second threshold value, wherein the first notification message is used for prompting a user to: and displaying the subtitles meeting the preset rule by using a subtitle function when the second video is played by using the preset application, wherein the second video is the same as or different from the first video.
Optionally, the display module is specifically configured to display the first notification message in a preset display form; the preset display form comprises the following steps: any one of a banner display, a notification center display, or a dialog display.
Optionally, when the electronic device opens the first video through the video application, the display module is specifically configured to display the first notification message in a preset display form; or, in the process that the electronic device plays the first video through the video application, the display module displays the first notification message in a preset display form; or, the display module displays the first notification message in a preset display form under the condition that the electronic device exits the video application.
Optionally, the processing module is further configured to obtain a subtitle detection result of the first video; and when the caption detection result represents that the first video does not comprise the caption, or when the caption detection result represents that the caption included in the first video does not meet the preset rule, the processing module acquires the user behavior data.
Optionally, the electronic device includes a machine playing skill; the game skill includes an operation method using a caption function; the first notification message includes: prompt information and a skip control related to the subtitle function; the processing module is also used for receiving a first triggering operation of the user for the jump control, and jumping to an operation method using the subtitle function in the machine playing skill in response to the first triggering operation.
Optionally, the first notification message includes: prompt information and control related to the subtitle function; the processing module is further used for receiving a second trigger operation of the user for the control, and responding to the second trigger operation, the electronic equipment displays the subtitles meeting the preset rule by using the subtitle function when the second video is played through the video application.
Optionally, when the second frequency is greater than the second threshold, the processing module is further configured to determine that the second video does not include subtitles when the second video is played through the preset application, or that the subtitles included in the second video do not meet a preset rule; and displaying the subtitles meeting the preset rule by using a subtitle function when the second video is played through the preset application.
Optionally, a computing engine and a sensing service are operated in the electronic device; registering a video playing event of a preset application in a sensing service; under the condition that the perception service monitors that the preset application plays the second video, the calculation engine is used for carrying out subtitle detection on the second video through a subtitle detection algorithm; the calculation engine is used for determining that the second video does not comprise the subtitles under the condition that the calculation engine cannot detect the subtitles within the first preset time period; the calculation engine is used for identifying the language of the subtitles when detecting the subtitles of the second video within a first preset time period, and determining that the subtitles included in the second video do not meet preset rules when the language of the subtitles is the first language and the system language of the electronic device acquired by the calculation engine is the second language.
Optionally, the electronic device further includes a communication module, where the communication module is configured to send a first request message to the big data image platform; the first request message includes an identification of the target account; the first request message is used for acquiring user behavior data of the target account; the communication module is also used for receiving the user behavior data sent by the big data image platform.
Optionally, the communication module sends a record of using the video application to the big data representation platform when the electronic device monitors that the video application is opened; the record includes an identification of the target account; and recording user behavior data for updating the target account of the big data representation platform.
Optionally, a computing engine, an intelligent reminder and a notification bar are operated in the electronic device; the computing engine is used for sending a push indication message to the intelligent reminder; the intelligent reminder is used for sending a recommendation notice to the notice board according to the push indication message; the notification bar is used for pushing a first notification message.
Optionally, a computing engine, an intelligent reminder, and an artificial intelligence subtitle application are operated in the electronic device; the computing engine is used for sending a pushing indication message to the intelligent reminder; the intelligent reminder is used for sending a recommendation notice to the artificial intelligent subtitle application according to the push indication message; the artificial intelligence subtitle application is used for displaying the first notice news through the dialog box.
In a third aspect, an embodiment of the present application provides an electronic device, where the electronic device includes a memory and a processor, the memory is used for storing a computer program, and the processor is used for executing the computer program to perform the message pushing method described in the first aspect or any one of the possible implementation manners of the first aspect.
In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program or an instruction is stored, and when the computer program or the instruction is executed on a computer, the computer is caused to execute the message pushing method described in the first aspect or any one of the possible implementation manners of the first aspect.
In a fifth aspect, the present application provides a computer program product including a computer program, which when the computer program runs on a computer, causes the computer to execute the message pushing method described in the first aspect or any one of the possible implementation manners of the first aspect.
In a sixth aspect, the present application provides a chip or a chip system, where the chip or the chip system includes at least one processor and a communication interface, where the communication interface and the at least one processor are interconnected by a line, and the at least one processor is configured to execute a computer program or instructions to perform the message pushing method described in the first aspect or any one of the possible implementations of the first aspect. The communication interface in the chip may be an input/output interface, a pin, a circuit, or the like.
In one possible implementation, the chip or chip system described above in this application further comprises at least one memory having instructions stored therein. The memory may be a storage unit inside the chip, such as a register, a cache, etc., or may be a storage unit of the chip (e.g., a read-only memory, a random access memory, etc.).
It should be understood that the second aspect to the sixth aspect of the present application correspond to the technical solutions of the first aspect of the present application, and the beneficial effects achieved by the aspects and the corresponding possible implementations are similar and will not be described again.
Drawings
Fig. 1 is a schematic view of a scene of a video played by an electronic device in an embodiment of the present application;
fig. 2 is a schematic view of another scene of a video played by an electronic device in an embodiment of the present application;
fig. 3 is a schematic diagram illustrating that an electronic device receives a user operation for opening a subtitle function and opens the subtitle function in response to the user operation in an embodiment of the present application;
FIG. 4 is a schematic structural diagram of a system to which an embodiment of the present application is applicable;
fig. 5 is a schematic structural diagram of an electronic device to which the embodiment of the present application is applied;
FIG. 6 is a block diagram of a software architecture of an electronic device to which embodiments of the present application are applicable;
FIG. 7 is a flowchart illustrating a method for collecting user behavior data using a video application according to an embodiment of the present application;
fig. 8 is a schematic diagram illustrating an operation of opening a video application according to an embodiment of the present application;
FIG. 9 is a flowchart illustrating another method for collecting user behavior data using a video application according to an embodiment of the present application;
fig. 10 is a flowchart illustrating a method for pushing a subtitle function according to an embodiment of the present application;
fig. 11 is a schematic flowchart of another subtitle function pushing method according to an embodiment of the present application;
fig. 12 is a schematic diagram illustrating a subtitle function pushing through a notification bar according to an embodiment of the present application;
fig. 13 is a schematic diagram illustrating a process of interaction between applications in a method for pushing a subtitle function according to an embodiment of the present application;
fig. 14 is a schematic flowchart of a message pushing method according to an embodiment of the present application;
fig. 15 is a schematic diagram illustrating playing a video through a video application according to an embodiment of the present application;
fig. 16 is a schematic diagram of displaying subtitles of a video through a floating window according to an embodiment of the present application;
fig. 17 is a schematic process diagram of interaction between applications in a message pushing method according to an embodiment of the present application;
fig. 18 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 19 is a schematic structural diagram of a chip according to an embodiment of the present application.
Detailed Description
In the embodiments of the present application, the terms "first", "second", and the like are used to distinguish the same or similar items having substantially the same function and effect. For example, the first chip and the second chip are only used for distinguishing different chips, and the sequence order thereof is not limited. Those skilled in the art will appreciate that the terms "first," "second," etc. do not denote any order or quantity, nor do the terms "first," "second," etc. denote any order or importance.
It should be noted that in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described herein as "exemplary" or "e.g.," is not necessarily to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the word "exemplary" or "such as" is intended to present concepts related in a concrete fashion.
In the embodiments of the present application, "at least one" means one or more, "a plurality" means two or more. "and/or" describes the association relationship of the associated object, indicating that there may be three relationships, for example, a and/or B, which may indicate: a exists alone, A and B exist simultaneously, and B exists alone, wherein A and B can be singular or plural. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. "at least one of the following" or similar expressions refer to any combination of these items, including any combination of the singular or plural items. For example, at least one (one) of a, b, or c, may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c can be single or multiple.
With the development of mobile internet technology, video applications are increasing, and the video applications provide convenience for life, entertainment, learning and work of people. However, in some usage scenarios, the video resources directly played by the electronic device using the video application cannot meet the user expectations, which brings a poor user experience to the user.
In one example, as shown in FIG. 1, audio 101 in a video played by an electronic device is not a language familiar to a user, and the video asset has no subtitles.
In another example, as shown in fig. 2, the audio in the video played by the electronic device is not in the language familiar to the user, and the video resources including the subtitles 201 are not in the language familiar to the user.
In another example, the user may be in an environment where it is inconvenient to listen to speech in the video being played, and the video asset may not include subtitles.
In the above examples, the video resources directly played by the electronic device using the video application cannot meet the user expectations, which brings a poor user experience to the user.
In some possible implementations, based on the example of fig. 1, the electronic device may receive voice instructions. Illustratively, the voice instruction may be "help me listen," and the electronic device then displays a floating window 301 as shown in a in fig. 3 in response to the voice instruction. The floating window 301 includes a voice ball 302 therein. After the electronic device receives the triggering operation of the user for the voice ball 302, the subtitle function can be turned on to display the subtitle 303 as shown in b in fig. 3. The subtitle function can be used for displaying subtitles corresponding to videos played by the video application on an electronic device interface. The user may drag the subtitle 303 to change the displayed position of the subtitle on the electronic device interface. However, many users do not know the subtitle function of the electronic device, and therefore in the case that the video resource directly played by the electronic device in the above example cannot reach the user's expectation, the users usually need to search for the video resource again, resulting in poor user experience.
In view of this, an embodiment of the present application provides a message pushing method, in which an electronic device displays subtitles meeting a preset rule according to user behavior data when a played video does not include subtitles or the included subtitles do not meet the preset rule, or the electronic device pushes related information of a subtitle function according to the user behavior data. Therefore, the electronic equipment can display the information conveyed by the audio corresponding to the video watched by the caption supplementary user no matter the caption meeting the preset rule is displayed through the caption function or the caption function related information is pushed to provide the method for opening the caption function for the user. Thereby improving the user experience.
For convenience of understanding, a system to which the message pushing method provided by the embodiment of the present application is applied is described below with reference to fig. 4. As shown in FIG. 4, the system includes big data representation platform 40 and a plurality of electronic devices 50, such as electronic device 50-1, electronic device 50-2, and electronic device 50-3 of FIG. 1.
The big data image platform 40 is used for collecting user behavior data of video applications used by each account sent by each electronic device 50 in the system. Further, whether to recommend a subtitle function to an account or open a subtitle function may be determined based on the acquired user behavior data. The user behavior data comprises the number of times that the account uses the video application in a preset time period and/or the number of times that the account uses the subtitle function in the preset time period. The big data imaging platform 40 may be a cloud server, a server, or a cluster of servers.
The electronic device 50 is configured to record user behavior data of the video application used by the account of the electronic device, and report the recorded user behavior data to the big data image platform 40.
The electronic device 50 may also be referred to as a terminal (terminal), a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), and the like. The electronic device 50 may be a mobile phone (mobile phone), a smart tv, a wearable device, a tablet computer (Pad), a computer with a wireless transceiving function, a Virtual Reality (VR) terminal device, an Augmented Reality (AR) terminal device, a wireless terminal in a self-driving (self-driving), a wireless terminal in a smart home (smart home), and so on. The embodiment of the present application does not limit the specific technology and the specific device form adopted by the electronic device 50.
In order to better understand the embodiment of the present application, the structure of the electronic device 50 in the embodiment of the present application is described below.
Fig. 5 shows a schematic structural diagram of the electronic device 50. The electronic device 50 may include a processor 110, an external memory interface 120, an internal memory 121, a Universal Serial Bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a Subscriber Identification Module (SIM) card interface 195, and the like.
The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and the like.
It is to be understood that the illustrated structure of the embodiment of the present application does not specifically limit the electronic device 50. In other embodiments of the present application, electronic device 50 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
Processor 110 may include one or more processing units, such as: the processor 110 may include an Application Processor (AP), a modem processor, a Graphics Processor (GPU), an Image Signal Processor (ISP), a controller, a video codec, a Digital Signal Processor (DSP), a baseband processor, and/or a neural-Network Processing Unit (NPU), etc. Wherein, the different processing units may be independent devices or may be integrated in one or more processors.
The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of instruction fetching and instruction execution.
A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to reuse the instruction or data, it may be called from memory. Avoiding repeated accesses reduces the latency of the processor 110, thereby increasing the efficiency of the system.
In some embodiments, processor 110 may include one or more interfaces. The interface may include an integrated circuit (I2C) interface, a universal asynchronous receiver/transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI), a general-purpose input/output (GPIO) interface, a Subscriber Identity Module (SIM) interface, and/or a Universal Serial Bus (USB) interface, etc.
It should be understood that the interface connection relationship between the modules illustrated in the embodiment of the present application is an illustrative description, and does not limit the structure of the electronic device 50. In other embodiments of the present application, the electronic device 50 may also adopt different interface connection manners or a combination of multiple interface connection manners in the above embodiments.
The charging management module 140 is configured to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive a wireless charging input through a wireless charging coil of the electronic device 50. The charging management module 140 may also supply power to the electronic device through the power management module 141 while charging the battery 142.
The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the display 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 may also be used to monitor parameters such as battery capacity, battery cycle count, battery state of health (leakage, impedance), etc. In some other embodiments, the power management module 141 may also be disposed in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be disposed in the same device.
The wireless communication function of the electronic device 50 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. The antenna in the electronic device 50 may be used to cover a single or multiple communication bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed as a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 150 may provide a solution including 2G/3G/4G/5G wireless communication applied to the electronic device 50. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a Low Noise Amplifier (LNA), and the like. The mobile communication module 150 may receive the electromagnetic wave from the antenna 1, filter, amplify, etc. the received electromagnetic wave, and transmit the electromagnetic wave to the modem processor for demodulation. The mobile communication module 150 may also amplify the signal modulated by the modem processor, and convert the signal into electromagnetic wave through the antenna 1 to radiate the electromagnetic wave. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the same device as at least some of the modules of the processor 110.
The modem processor may include a modulator and a demodulator. The modulator is used for modulating a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then passes the demodulated low frequency baseband signal to a baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor displays images or video via the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional modules, independent of the processor 110.
The wireless communication module 160 may provide a solution for wireless communication applied to the electronic device 50, including Wireless Local Area Networks (WLANs) (e.g., wireless fidelity (Wi-Fi) networks), bluetooth (bluetooth, BT), Global Navigation Satellite System (GNSS), Frequency Modulation (FM), Near Field Communication (NFC), Infrared (IR), and the like. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, performs frequency modulation and filtering on electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and convert the signal into electromagnetic waves through the antenna 2 to radiate the electromagnetic waves.
In some embodiments, antenna 1 of electronic device 50 is coupled to mobile communication module 150 and antenna 2 is coupled to wireless communication module 160 so that electronic device 50 can communicate with networks and other devices through wireless communication techniques. The wireless communication technology may include global system for mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), time-division code division multiple access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and/or IR technologies, among others. GNSS may include Global Positioning System (GPS), global navigation satellite system (GLONASS), beidou satellite navigation system (BDS), quasi-zenith satellite system (QZSS), and/or Satellite Based Augmentation System (SBAS).
The electronic device 50 implements display functions via the GPU, the display screen 194, and the application processor. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.
The display screen 194 is used for displaying images, displaying videos, receiving slide operations, and the like. The display screen 194 includes a display panel. The display panel may be a Liquid Crystal Display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (active-matrix organic light-emitting diode, AMOLED), a flexible light-emitting diode (FLED), a miniature, a Micro-o led, a quantum dot light-emitting diode (QLED), or the like. In some embodiments, the electronic device 50 may include 1 or N display screens 194, with N being a positive integer greater than 1.
The electronic device 50 may implement a shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, the application processor, and the like.
The ISP is used to process the data fed back by the camera 193. For example, when a photo is taken, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converting into an image visible to naked eyes. The ISP can also carry out algorithm optimization on the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in camera 193.
The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The light sensing element converts the optical signal into an electrical signal, which is then passed to the ISP where it is converted into a digital image signal. And the ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into image signal in standard RGB, YUV and other formats. In some embodiments, electronic device 50 may include 1 or N cameras 193, N being a positive integer greater than 1.
The digital signal processor is used for processing digital signals, and can process digital image signals and other digital signals. For example, when the electronic device 50 selects a frequency bin, the digital signal processor is used to perform fourier transform or the like on the frequency bin energy.
Video codecs are used to compress or decompress digital video. The electronic device 50 may support one or more video codecs. In this way, electronic device 50 may play or record video in a variety of encoding formats, such as: moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, and the like.
The NPU is a neural-network (NN) computing processor that processes input information quickly by using a biological neural network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. Applications such as intelligent recognition of the electronic device 50 can be realized by the NPU, for example: image recognition, face recognition, speech recognition, text understanding, and the like.
The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the electronic device 50. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.
The internal memory 121 may be used to store computer-executable program code, which includes instructions. The internal memory 121 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The data storage area may store data created during use of the electronic device 50 (e.g., audio data, a phonebook, etc.), and the like. Illustratively, the storage data area stores user behavior data recorded by the electronic device 50. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (UFS), and the like. The processor 110 executes various functional applications of the electronic device 50 and data processing by executing instructions stored in the internal memory 121 and/or instructions stored in a memory provided in the processor.
In some embodiments, the electronic device 50 may further include one or more of a key 190, a motor 191, an indicator 192, and a SIM card interface 195 (or eSIM card), which is not limited in any way by the embodiments of the present application.
The software system of the electronic device 50 may be a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, a cloud architecture, or the like. The embodiment of the present application takes an Android system with a layered architecture as an example, and exemplarily illustrates a software structure of the electronic device 50.
Fig. 6 is a block diagram of a software structure of an electronic device according to an embodiment of the present application.
The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into five layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, a hardware abstraction layer, and a kernel layer from top to bottom.
The application layer may include a series of application packages. As shown in fig. 6, the application packages may include applications such as cameras, video applications, perceptual services, computing engines, intelligent reminders, game skills, and Artificial Intelligence (AI) subtitles.
The sensing service operates in the electronic device after the electronic device is powered on, and the sensing service may detect a related event and acquire a state of the event from another application program or an application program framework layer or a system layer or a kernel layer of an application program layer through an Application Programming Interface (API).
The computing engine may be configured to receive an indication message sent by the sensing service, and perform corresponding processing according to the indication message.
The intelligent reminder may be configured to receive a push indication message sent by the computing engine, and send a recommendation notification to the notification bar according to the push indication message, where the recommendation notification is used for the notification bar to send an AI subtitle function recommendation card, and the AI subtitle function recommendation card may include an introduction of an AI subtitle. The electronic device may display the AI caption function recommendation card through the notification bar. The AI caption function recommendation card includes a link to detailed information related to the AI caption function in the machine play skill. In the case where the user triggers the link, the electronic device opens detailed information related to the AI caption function in the player technique in response to the triggering operation.
The AI subtitle is used for displaying the subtitle corresponding to the video in real time in the process of playing the video.
The machine playing skills provide the user with a number of methods of using the functions in the handset. Illustratively, the machine-playing skill includes detailed information about the AI caption function, such as a method of using the AI caption function.
The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.
As shown in FIG. 6, the application framework layers may include a window manager, an activity manager, a package manager, a resource manager, a view system, and a notification manager, among others.
A Window Manager (WMS) is used to manage the window program. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.
The activity manager is used for managing the life cycle of each application program and the navigation backspacing function. The method is responsible for establishing the main thread of the Android and maintaining the life cycle of each application program.
The package manager is used for program management within the system, for example: application installation, uninstallation, upgrade, and the like.
The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.
The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.
The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, prompting text information in the status bar, sounding a prompt tone, vibrating the electronic device, flashing an indicator light, etc.
The Android runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system.
The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.
The application layer and the application framework layer run in a virtual machine. And executing java files of the application layer and the application framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like. A display composition process (e.g., surface flicker) also runs in the virtual machine. The display composition process is used to control the composition of the images.
The system library may include a plurality of functional modules. For example: the system comprises an image drawing module, an image rendering module, an image synthesis module, a function library, a media library and the like.
The image drawing module is used for drawing two-dimensional or three-dimensional images. The image rendering module is used for rendering two-dimensional or three-dimensional images. The image synthesis module is used for synthesizing two-dimensional or three-dimensional images.
The function library provides macros, type definitions, character string operation functions, mathematical calculation functions, input and output functions, and the like used in the C language.
The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
The hardware abstraction layer may include a plurality of library modules, which may be, for example, hardware configuration modules (hwcomposers, HWCs), camera library modules, and the like. The Android system can load corresponding library modules for the equipment hardware, and then the purpose that the application program framework layer accesses the equipment hardware is achieved. The device hardware may include, for example, an LCD screen, a camera, etc. in the electronic device.
The kernel layer is a layer between hardware and software. The kernel layer is used for driving hardware so that the hardware works. The kernel layer at least comprises a display driver, an audio driver, a camera driver, a sensor driver and the like.
The hardware may be audio devices, bluetooth devices, camera devices, sensor devices, etc.
Before describing the message pushing method provided by the embodiment of the present application, a process of collecting user behavior data using a video application by a big data imaging platform in the embodiment of the present application is described below.
Fig. 7 is a flowchart illustrating a method for collecting user behavior data using a video application according to an embodiment of the present application. The method of fig. 7 is suitable for use in the system of fig. 4, and the method of fig. 7 includes the following steps:
s700: the electronic equipment receives a first user operation aiming at the video application icon, and the electronic equipment opens the video application in response to the first user operation.
In the embodiment of the application, after the electronic device is powered on, a launcher, an activity manager and the like operate. A video application is an application for playing a video asset.
In a possible implementation manner, the launcher in the electronic device receives the first user operation, and invokes a process of creating the video application by the activity manager in the system service in response to the first user operation, and then the electronic device displays an interface after the video application is opened on the display screen.
Illustratively, as shown in fig. 8, the electronic device receives a trigger operation for a video application icon 801 at an interface shown in a, and the electronic device opens the interface shown in b in response to the trigger operation.
S701: the electronic device sends a user's recording of use of the video application to the big data representation platform in response to opening of the video application.
In this embodiment, the record of the user using the video application may include an account identifier corresponding to the electronic device, an identifier of the video application, a use time of the video application, and the like. The electronic equipment runs with the perception service after being electrified. The account identifier may be an account identifier of the terminal device, and the account identifier may also be an account identifier of the video application, which is not limited in this embodiment of the present application.
In one possible implementation manner, a sensing service in the electronic device registers a process creation event of a preset application in a starting process of the electronic device. The preset application is a preset video application. The process creation event of the preset application may include an identification of the preset application. For example, the identifier of the preset application may be a package name of the preset application. Illustratively, the awareness service may listen to the creation of a process of a preset application in the electronic device. The sensing service triggers and starts the calculation engine and sends a first indication message to the calculation engine under the condition that the application identifier of the creating process is monitored to be a preset application identifier. And the computing engine calls a communication module in the electronic equipment to send a record of the user using the preset application to the big data representation platform under the condition of receiving the first indication message.
It is understood that the preset application may be preset in the electronic device, and the preset application may be updated during the system upgrade of the electronic device. Alternatively, the preset application may be user-set in a white list. The electronic equipment receives an operation of modifying the white list by a user and updates the preset application in response to the operation.
Illustratively, the record of the video application used by the user, which is sent by the electronic device to the big data imaging platform, includes an account identifier of a first account, an identifier of a video application and a usage time of the video application, i.e., 12: 30/12/2021.
S702: and the big data image platform updates the user behavior data of the account corresponding to the account identification according to the received record.
Illustratively, the user behavior data stored in the big data representation platform is updated as shown in Table 1 below:
TABLE 1
Figure 135385DEST_PATH_IMAGE001
Table 1 includes 7 records with the account id being the first account. Based on the example recorded in S701, the user behavior data stored in the big data representation platform is updated as shown in Table 2 below:
TABLE 2
Figure 34071DEST_PATH_IMAGE002
The user behavior data shown in table 2 is added with a record received by the big data imaging platform for characterizing that the first account uses the video application a at 12 o 'clock, 17 o' clock, 12 o 'clock, 30 o' clock in 2021.
Fig. 9 is a flowchart illustrating another method for collecting user behavior data using a video application according to an embodiment of the present application. The method of fig. 9 is suitable for use in the system of fig. 4, and the method of fig. 9 includes the following steps:
s900: and the electronic equipment receives a second user operation in the process of running the video application, and the electronic equipment responds to the second user operation to quit the video application.
S901: the electronic device, in response to the exit of the video application, sends a record of the user's use of the video application to the big data representation platform.
In the embodiment of the application, the electronic equipment runs with the sensing service after being electrified. A sensing service in the electronic device registers an exit event of the video application during startup of the electronic device. Wherein the exit event of the video application may include an identification of the video application. Illustratively, the identification of the video application may be a package name of the video application. In this way, the awareness service can listen for the exit of the video application in the electronic device.
In a possible implementation manner, the sensing service in the electronic device sends the exit event of the video application to the computing engine when the identifier of the application in the application exit event is monitored to be the identifier of the video application in the exit event of the video application registered in advance. And under the condition of receiving an exit event of the video application, the computing engine calls a communication module in the electronic equipment to send a record of the video application used by the user to the big data representation platform. The identification of the video application in the exit event of the video application registered in advance is the identification of the preset application. The description and the updating manner of the application are preset, and refer to the description in S701, which is not described again.
S902: and the big data image platform updates the user behavior data of the account corresponding to the account identification according to the received record.
The possible implementation manners refer to the description in S702, and are not described again.
As can be appreciated, the electronic device using the predetermined application may each send user behavior data using the predetermined application to the big data representation platform. Under the condition that the big data imaging platform collects user behavior data using preset applications, the electronic equipment can acquire the user behavior data of an account from the big data imaging platform and push related information of the subtitle function based on the acquired user behavior data. The subtitle function related information may include an operation step for displaying a subtitle corresponding to a played video on an electronic device interface. The user can learn the related information of the caption function and start the caption function. In this way, the electronic device may receive a user operation and display subtitles meeting a preset rule in response to the user operation during a process in which the electronic device plays a video using a preset application.
The following describes a subtitle function pushing method provided by an embodiment of the present application with reference to the accompanying drawings.
Fig. 10 is a schematic flowchart of a method for pushing a subtitle function according to an embodiment of the present application. The subtitle function pushing method shown in fig. 10 is applied to the system shown in fig. 4, and the method shown in fig. 10 includes the following steps:
s1000: the electronic equipment receives a first user operation aiming at the video application icon, and the electronic equipment opens the video application in response to the first user operation.
The possible implementation manner refers to the description in S700, and is not described in detail.
S1001: the electronic device sends a user's recording of use of the video application to the big data representation platform in response to opening of the video application.
For possible implementation, reference is made to the description in S701, which is not repeated.
S1002: the electronic equipment judges whether the played video comprises subtitles or not in the process of playing the video by the video application, if so, the S1003 is executed, and if not, the S1004 is executed.
In a possible implementation manner, a sensing service is operated in the electronic device, an event that the video application plays the video is registered in the sensing service in the starting process of the electronic device, when the sensing service monitors that the video application plays the video, the sensing service triggers and starts the computing engine and sends a second indication message to the computing engine, the second indication message is used for indicating the computing engine to perform subtitle detection, and the computing engine can acquire a frame to be displayed from a frame to be displayed synthesized in a display synthesis process and perform subtitle detection on the frame to be displayed through a subtitle detection algorithm. The subtitle detection algorithm may be an Optical Character Recognition (OCR) algorithm. In the case where the calculation engine does not detect the subtitles within the first preset time period, the calculation engine determines that the video does not include the subtitles.
S1003, carrying out: the electronic device determines whether the language of the subtitle is the same as the system language of the electronic device, if so, the process ends, and if not, S1004 is executed.
In a possible implementation manner, a computing engine in the electronic device identifies a language of a subtitle, and when the language of the subtitle is a first language and a system language of the terminal acquired by the computing engine is a second language, the computing engine determines that the subtitle included in the video does not satisfy a preset rule.
Illustratively, the system language of the electronic device is Chinese, the language of the subtitles is English, and the computing engine in the electronic device determines that the subtitles included in the video do not satisfy the preset rules.
S1004: the electronic equipment sends a first request message to the big data image platform. Wherein the first request message includes an identification of the target account.
In the embodiment of the application, the first request message is used for acquiring user behavior data of the target account. The target account may be an account of the electronic device, and the target account may also be an account of the video application, which is not limited in this embodiment of the present application. Optionally, the first request message further includes an identification of the video application.
S1005: and the big data imaging platform acquires the record number included in the user behavior data corresponding to the identification of the target account in a second preset time period according to the collected user behavior data.
In a possible implementation manner, the big data image platform counts the record number included in the user behavior data corresponding to the identifier of the target account within the second preset time period according to the collected user behavior data.
Based on the example of table 2, if the identifier of the target account is the first account, the second preset time period is 15 days, and the big data imaging platform counts the number of records included in the user behavior data corresponding to the identifier of the target account within 15 days according to the collected user behavior data, and the number of records is 8.
In another possible implementation manner, the big data image platform counts the number of records included in the user behavior data corresponding to the identifier of the target account and the identifier of the video application in the second preset time period according to the collected user behavior data.
Based on the example of table 2, if the identifier of the target account is the first account, the second preset time period is 15 days, the identifier of the video application is the identifier of the video application a, and the big data imaging platform counts the number of records included in the user behavior data corresponding to the identifier of the target account within 15 days to be 6 according to the collected user behavior data.
S1006: and the big data image platform sends the acquired record number to the electronic equipment.
S1007: and when the number of the received records is larger than a first threshold value, the electronic equipment determines that the user behavior data indicates a caption pushing function, and the electronic equipment pushes relevant information of the caption pushing function.
In the embodiment of the application, the information related to the subtitle function comprises operation steps for displaying the subtitle corresponding to the video on the interface of the electronic equipment.
In a possible implementation manner, when the calculation engine in the electronic device determines that the number of received records is greater than the first threshold, the calculation engine triggers and starts the intelligent reminder and sends a push indication message to the intelligent reminder, and the intelligent reminder sends a recommendation notification to the AI subtitle application according to the push indication message, where the recommendation notification is used for the AI subtitle application to push the subtitle function related information. The AI subtitle application pushes subtitle function related information through a floating window or dialog.
Illustratively, as shown in a in fig. 3, in the case that the played video does not include subtitles, the electronic device pushes subtitle function related information by using the floating window 301.
In this way, the user can click on the voice ball 302 to display the subtitles of the played video, seeing the floating window 301 as shown in a in fig. 3. The electronic device may receive and respond to the click operation to display the subtitles 303 that satisfy the preset rules.
In the embodiment of the application, the electronic equipment can push the related information of the subtitle function under the condition that the video played by the electronic equipment does not comprise the subtitles or the subtitles do not meet the preset rule according to the frequency of the video application used by the user, so that the operation step of displaying the subtitles corresponding to the video is pushed to the user in time, the user can conveniently open the subtitles displayed by the subtitle function to supplement the information transmitted by the audio corresponding to the watched video, and the user experience is improved.
Fig. 11 is a flowchart illustrating another subtitle function pushing method according to an embodiment of the present application. The subtitle function pushing method shown in fig. 11 is applicable to the system shown in fig. 4, and the method shown in fig. 11 includes the following steps:
s1100: and the electronic equipment receives a second user operation in the process of running the video application, and the electronic equipment responds to the second user operation to quit the video application.
S1101: the electronic device sends a first request message to the big data representation platform in response to the exit of the video application. Wherein the first request message includes an identification of the target account.
In the embodiment of the application, the first request message is used for acquiring user behavior data of the target account.
S1102: and the big data imaging platform acquires the record number included in the user behavior data corresponding to the identification of the target account in a second preset time period according to the collected user behavior data.
The possible implementation manner refers to the description in S1005 and is not described in detail.
S1103: and the big data image platform sends the acquired record number to the electronic equipment.
S1104: and when the number of the received records is larger than a first threshold value, the electronic equipment pushes the related information of the subtitle function.
In a possible implementation manner, a computing engine in the electronic device sends a push indication message to the intelligent reminder, and the intelligent reminder sends a recommendation notification to the notification bar according to the push indication message, where the recommendation notification is used for the notification bar to send an AI subtitle function recommendation card, and the AI subtitle function recommendation card may include an introduction of an AI subtitle. The electronic device may display the AI caption function recommendation card through the notification bar.
The AI caption function recommendation card includes a link to detailed information related to the AI caption function in the machine play skill. In the case where the user triggers the link, the electronic device opens detailed information related to the AI caption function in the machine playing skill in response to the triggering operation.
Illustratively, as shown in a in fig. 12, the electronic device pushes an AI subtitle function recommendation card 1201 through the notification bar after the video application exits. The AI caption function recommendation card 1201 includes a play skill control 1202 that the user can click on. The electronic device receives the click operation and displays detailed information about the AI subtitle function in the machine playing skill as shown in b of fig. 12 in response to the click operation.
Another possible scenario is where the AI caption function recommendation card includes a caption control for opening the caption function. And under the condition that the user triggers the subtitle control, the electronic equipment responds to the triggering operation to judge whether the subtitle function in the electronic equipment is opened, and if not, the subtitle function is opened. Further electronic devices may display methods to assist a user in using the subtitle function. If the video does not contain the subtitles or the subtitles contained in the video do not meet the preset rules, the electronic equipment displays the subtitles meeting the preset rules.
In another possible implementation manner, the electronic device plays the information related to the subtitle function through voice.
For convenience of understanding, the following describes interactions between applications in the subtitle function pushing method provided in the embodiment of the present application with reference to fig. 13.
Fig. 13 is a schematic diagram illustrating a process of interaction between applications in a method for pushing a subtitle function according to an embodiment of the present application:
the application layer of the electronic device as shown in FIG. 13 includes video applications, perception services, computing engines, intelligent reminders, notification bars, and game skills.
The interaction flow diagram of fig. 13 includes the following steps:
s1301: the video application plays the video.
In the embodiment of the application, the video application belongs to a preset application. The description of the preset application refers to the description in S701, and is not repeated.
S1302: the awareness service listens to the video application state.
In the embodiment of the application, the video application state includes opening of the video application, video playing of the video application, exit of the video application, and the like.
In a possible implementation manner, the sensing service registers events such as a process creation event of a preset application, a process shutdown event of the preset application, and/or a video playing event of the preset application in the starting process of the electronic device. The sensing service monitors the video application state according to the registered event.
S1303: the awareness service sends a first indication message to the compute engine upon listening for an exit of the video application.
In the embodiment of the application, the first indication message is used for indicating the computing engine to send the first request message to the big data image platform through the communication module. The description of the first request message refers to S1004 and is not repeated.
S1304: the computing engine sends a first request message to the big data imaging platform through a communication module of the electronic device under the condition that the first indication message from the perception service is received.
S1305: and the big data imaging platform acquires user behavior data corresponding to the identification of the target account in a second preset time period according to the collected user behavior data.
In this embodiment of the present application, the user behavior data corresponding to the identifier of the target account may be data itself or a record number itself, which is not limited in this embodiment of the present application.
For possible implementation, reference is made to the description in S1005, and details are not repeated.
S1306: and the big data image platform sends the user behavior data of the target account to the electronic equipment.
S1307: the calculation engine determines whether the caption function pushing condition is satisfied according to the acquired user behavior data, and if so, executes S1308. If not, no processing is carried out.
The possible implementation manner refers to the description in S1007 and is not described in detail.
S1308: the computing engine sends a push indication to the intelligent reminder.
S1309: and sending a recommendation notification to the notification bar under the condition that the intelligent reminder receives the push instruction.
S1340: and the notification bar displays an AI subtitle function recommendation card according to the recommendation notification.
The card includes a link to detailed information related to AI caption functions in the game technique.
S1341: in the event that the user triggers a link in the AI caption function card, the notification bar sends a jump instruction to the player technique.
S1342: and displaying detailed information related to the AI subtitle function in the player skill according to the jump instruction by the player skill.
In the embodiment of the application, the electronic equipment pushes the related information of the subtitle function according to the frequency of the video application used by the user under the condition that the video application exits so as to push the subtitle function to the user, and the user can conveniently display the subtitle on the video played by the electronic equipment by opening the subtitle function to supplement the information transmitted by the audio corresponding to the watched video under the condition of need, so that the user experience is improved.
It will be appreciated that the user may be able to use the subtitle functionality when the electronic device pushes it to the user, and that the electronic device may also include information on whether to use the subtitle functionality when sending a recording of the user's use of the video application to the big data representation platform. In this way, the user behavior data collected in the big data portrayal platform can be shown in table 3 below:
TABLE 3
Figure 243074DEST_PATH_IMAGE003
The last column in the record in table 3 stores information on whether the subtitle function is used, and the information on whether the subtitle function is used in the record in the first row in table 3 is yes, which indicates that the subtitle function is used when the video application a is used by the first account at 20 o' clock 12/7/2021. The information on whether or not the subtitle function is used in the record in the second row in table 3 is no, and this information indicates that the subtitle function is not used when the first account uses the a video application for 20 points 30 at 12, 8 and 2021. The explanations of the other rows are similar and will not be described again.
In the case that the user behavior data collected by the big data imaging platform includes information on whether to use the subtitle function, the user behavior data acquired by the electronic device from the big data imaging platform may further include information on the use of the subtitle function. In this way, the electronic device may automatically display the subtitles meeting the preset rule for the video not including the subtitles or the video not meeting the preset rule including the subtitles during the process of playing the video according to the number of times the subtitle function is used by the target account within the second preset time period.
It is to be understood that, in the case that the user behavior data of the target account acquired by the electronic device includes information about using the subtitle function, or includes a number of times of using the subtitle function that is greater than the second threshold, the electronic device may not push the information about the subtitle function any more. Wherein the second threshold may be 1.
Illustratively, the user behavior data of the target account acquired by the electronic device from the big data imaging platform includes a first record count and a second record count, where the first record count is the total number of records of the user behavior data corresponding to the identifier of the target account in a second preset time period, and the second record count is the number of records representing the use of the subtitle function in the user behavior data corresponding to the identifier of the target account. And when the second recording number is less than 1 and the first recording number is greater than a first threshold value, the electronic equipment pushes the related information of the subtitle function, and when the second recording number is greater than or equal to 1, the electronic equipment does not push the related information of the subtitle function.
Exemplarily, fig. 14 is a schematic flowchart of a message pushing method provided in an embodiment of the present application. The message pushing method shown in fig. 14 includes the following steps:
s1400: and the electronic equipment receives a third user operation in the process of running the video application and responds to the third user operation to play the video.
For example, as shown in fig. 15, after the video application is opened, the electronic device receives a click operation for the video control 1500, and plays a video corresponding to the video control 1500 in response to the click operation.
S1401: the electronic device judges whether the played video includes subtitles or not in the process of playing the video by the video application, if so, executes S1402, and if not, executes S1403.
The possible implementation manner refers to the description in S1002, and is not described in detail.
S1402: the electronic device determines whether the language of the subtitle is the same as the system language of the electronic device, if so, the process ends, and if not, S1403 is executed.
In a possible implementation manner, the electronic device acquires a plurality of characters in the subtitle, identifies the language of the subtitle according to the probability that the characters belong to preset characters in each language, and judges whether the identified language is the same as the system language of the electronic device.
For example, in the case that all of the characters in the subtitle acquired by the electronic device are english characters, the electronic device determines that the subtitle language is english. If the system language of the electronic device is Chinese, the electronic device determines that the identified language is different from the system language of the electronic device.
S1403: and the electronic equipment sends a second request message to the big data image platform. Wherein the second request message includes an identification of the target account.
In the embodiment of the application, the first request message is used for acquiring user behavior data of the target account. Optionally, the second request message further includes an identification of the video application.
S1404: and the big data image platform acquires a second record number using the subtitle function in the user behavior data corresponding to the identification of the target account in a second preset time period according to the collected user behavior data.
In a possible implementation manner, the big data image platform counts a second record number of the subtitle function used by the user behavior data corresponding to the identifier of the target account in a second preset time period according to the collected user behavior data.
Based on the example in table 3, if the identifier of the target account is the first account and the second preset time period is 15 days, the big data imaging platform counts a second record number of using the subtitle function included in the user behavior data corresponding to the identifier of the target account within 15 days according to the collected user behavior data, and the second record number is 5.
S1405: and the big data image platform sends the acquired second record number to the electronic equipment.
S1406: and when the second record number is larger than a third threshold value, the electronic equipment determines that the user behavior data indicates that the subtitle function is automatically started, and displays the subtitles meeting the preset rule in the video playing process.
In a possible implementation manner, a calculation engine in the electronic device determines that a user behavior data indicates to automatically start a subtitle function, the calculation engine in the electronic device sends a subtitle indication message to the intelligent reminding module, and the intelligent reminding module sends a subtitle indication to the AI subtitle when receiving the subtitle indication message, wherein the subtitle indication is used for calling the AI subtitle to display a subtitle represented by a system language corresponding to a video in the process of playing the video.
In one example, the AI subtitle obtains an audio signal in a video, performs speech recognition processing on the audio signal to obtain a text corresponding to the audio signal, recognizes a text language, and displays the text corresponding to the audio signal of the video in the process of playing the video by the AI subtitle when the text language is the same as a system language. In the case where the text language is different from the system language, the electronic device converts the text into a text expressed in the system language and displays the text expressed in the system language corresponding to the audio signal of the video during the playing of the video. Illustratively, as shown in fig. 16, the electronic device displays text 1600 corresponding to the audio signal of the video in the floating window shown in fig. 16 during the process of playing the video.
For convenience of understanding, the following describes interactions between applications in the message pushing method provided in the embodiment of the present application with reference to fig. 17.
Fig. 17 is a schematic process diagram of interaction between applications in a message pushing method according to an embodiment of the present application:
the application layers of the electronic device as shown in fig. 17 include video applications, perceptual services, computational engines, intelligent reminders, and AI subtitles.
The interaction process diagram shown in fig. 17 includes the following steps:
s1701: the video application plays the video.
In the embodiment of the application, the video application belongs to a preset application. The description of the preset application refers to the description in S701, and is not repeated.
S1702: the awareness service listens to the video application state.
In the embodiment of the application, the video application state includes opening of the video application, video playing of the video application, exit of the video application, and the like.
In a possible implementation manner, the sensing service registers events such as a process creation event of a preset application, a process shutdown event of the preset application, and/or a video playing event of the preset application in the starting process of the electronic device. The sensing service monitors the video application state according to the registered event.
S1703: and the perception service sends a second indication message to the calculation engine under the condition that the video application is monitored to play the video.
In this embodiment of the application, the second indication message is used to instruct the computing engine to determine whether a video played by the video application includes subtitles that meet a preset rule.
S1704: and the calculation engine judges whether the video played by the video application comprises the subtitles meeting the preset rule, if so, the processing is not carried out, and if not, the step S1705 is executed.
For possible implementation manners, reference is made to the descriptions in S1401 to S1402, and details are not repeated.
S1705: the compute engine invokes the communication module to send a second request message to the data-rendering platform.
In the embodiment of the present application, the description of the second request message refers to the description in the SS1403, and is not described again.
S1706: and the big data imaging platform acquires user behavior data corresponding to the identification of the target account in a second preset time period according to the collected user behavior data.
The description in S1404 is referred to for possible implementation and is not repeated.
S1707: and the big data image platform sends the user behavior data of the target account to the electronic equipment.
S1708: and the calculation engine judges whether the user behavior data of the target account indicates automatic subtitle opening, and if so, executes S1709. If not, no processing is carried out.
The possible implementation manner refers to the description in S1406, and is not described in detail.
S1709: the calculation engine sends a caption indication to the intelligent reminder.
S1710: and the intelligent reminder sends the caption indication to the AI caption under the condition of receiving the caption indication.
S1711: and displaying the subtitles meeting the preset rule by the AI subtitles in the process of playing the video.
In the embodiment of the application, when the played video does not include the subtitles or the subtitles included in the video do not meet the preset rules, the electronic device can automatically display the subtitles meeting the preset rules in the process of playing the video under the condition that the acquired user behavior data indicates that the subtitle function is automatically started, so that information conveyed by the audio corresponding to the video watched by the user is supplemented, and the user experience is improved.
The scheme provided by the embodiment of the application is mainly introduced from the perspective of a method. To implement the above functions, it includes hardware structures and/or software modules for performing the respective functions. Those of skill in the art will readily appreciate that the present application is capable of hardware or a combination of hardware and computer software implementing the exemplary method steps described in connection with the embodiments disclosed herein. Whether a function is performed as hardware or computer software drives hardware depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the embodiment of the present application, according to the method example, a device for implementing a subtitle pushing method and a message pushing method may be divided into functional modules, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module. Illustratively, the functions of the target application, drawing interface, and display engine are integrated in the display control unit. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that, in the embodiment of the present application, the division of the module is schematic, and is only one logic function division, and there may be another division manner in actual implementation.
Fig. 18 is a schematic structural diagram of an electronic device according to an embodiment of the present application. The electronic device 180 includes a processing module 1801 and a display module 1802; the processing module 1801 is configured to: playing a first video through a video application; the video application belongs to a preset application; acquiring user behavior data; the user behavior data comprises a first frequency and a second frequency; the first frequency is the frequency of using a preset application by the target account; the second frequency is the frequency of using the subtitle function by the target account; the display module 1802 is configured to: and displaying a first notification message under the condition that the first frequency is greater than a first threshold value and the second frequency is less than a second threshold value, wherein the first notification message is used for prompting a user to: and displaying the subtitles meeting the preset rule by using a subtitle function when the second video is played by using the preset application, wherein the second video is the same as or different from the first video. For example, with reference to fig. 7, the processing module 1801 may be configured to execute S700, with reference to fig. 9, the processing module 1801 may be configured to execute S900, and with reference to fig. 10, the processing module 1801 may be configured to execute S1000, S1002 to S1003. The display module 1802 may be configured to perform S1007. In conjunction with fig. 11, the processing module 1801 may be configured to perform S1100, and the display module 1802 may be configured to perform S1104. Referring to fig. 14, the processing module 1801 may be configured to execute S1400 to S1402, and the display module 1802 may be configured to execute S1406.
Optionally, the display module 1802 is specifically configured to display the first notification message in a preset display form; the preset display form comprises the following steps: any one of a banner display, a notification center display, or a dialog display.
Optionally, when the electronic device opens the first video through the video application, the display module 1802 is specifically configured to display the first notification message in a preset display form; or, in the process that the electronic device plays the first video through the video application, the display module 1802 specifically displays the first notification message in a preset display form; alternatively, in the case where the electronic device exits the video application, the display module 1802 displays the first notification message in a preset display form.
Optionally, the processing module 1801 is further configured to obtain a subtitle detection result of the first video; the processing module 1801 obtains the user behavior data when the caption detection result indicates that the first video does not include the caption, or when the caption detection result indicates that the caption included in the first video does not satisfy the preset rule.
Optionally, the electronic device includes a machine playing skill; the game technique includes an operation method using a subtitle function; the first notification message includes: prompt information and a skip control related to the subtitle function; the processing module 1801 is further configured to receive a first trigger operation of the user for the jump control, and jump to an operation method using a subtitle function in the machine playing skill in response to the first trigger operation.
Optionally, the first notification message includes: prompt information and control related to the subtitle function; the processing module 1801 is further configured to receive a second trigger operation of the user for the control, and in response to the second trigger operation, the electronic device displays a subtitle meeting the preset rule by using a subtitle function when playing a second video through the video application.
Optionally, when the second frequency is greater than the second threshold, the processing module 1801 is further configured to determine that the second video does not include subtitles when the second video is played through the preset application, or that the subtitles included in the second video do not meet a preset rule; and displaying the subtitles meeting the preset rule by using a subtitle function when the second video is played through the preset application.
Optionally, a computing engine and a sensing service are operated in the electronic device; registering a video playing event of a preset application in a sensing service; under the condition that the sensing service monitors that the preset application plays the second video, the calculation engine is used for carrying out caption detection on the second video through a caption detection algorithm; under the condition that the calculation engine cannot detect the subtitles within the first preset time period, the calculation engine is used for determining that the second video does not comprise the subtitles; the calculation engine is used for identifying the language of the subtitles when detecting the subtitles of the second video within a first preset time period, and determining that the subtitles included in the second video do not meet preset rules when the language of the subtitles is the first language and the system language of the electronic device acquired by the calculation engine is the second language.
Optionally, the electronic device further includes a communication module 1803, where the communication module 1803 is configured to send a first request message to the big data image platform; the first request message includes an identification of the target account; the first request message is used for acquiring user behavior data of the target account; the communication module 1803 is further configured to receive user behavior data sent from the big data imaging platform.
Optionally, when the electronic device monitors that the video application is opened, the communication module 1803 sends a record of using the video application to the big data image platform; the record includes an identification of the target account; and recording user behavior data for updating the target account of the big data representation platform.
Optionally, a computing engine, an intelligent reminder and a notification bar are operated in the electronic device; the computing engine is used for sending a pushing indication message to the intelligent reminder; the intelligent reminder is used for sending a recommendation notice to the notice board according to the push indication message; the notification bar is used for pushing a first notification message.
Optionally, a computing engine, an intelligent reminder and an artificial intelligent subtitle application are operated in the electronic device; the computing engine is used for sending a pushing indication message to the intelligent reminder; the intelligent reminder is used for sending a recommendation notice to the artificial intelligent subtitle application according to the push indication message; the artificial intelligence subtitle application is used for displaying the first notice news through the dialog box.
In one example, in conjunction with fig. 5, the functions of the processing module 1801 may be implemented by the processor 110 in fig. 5 executing computer instructions in the internal memory 121, and the functions of the display module 1802 may be implemented by the display screen 194. The communication module 1803 may be implemented by the mobile communication module 150 or the wireless communication module 160 in fig. 5.
Fig. 19 is a schematic structural diagram of a chip according to an embodiment of the present application. Chip 190 includes one or more (including two) processors 1901, communication lines 1902, and a communication interface 1903, and optionally, chip 190 also includes a memory 1904.
In some embodiments, memory 1904 stores the following elements: an executable module or a data structure, or a subset thereof, or an expanded set thereof.
The method described in the above embodiments of the present application may be applied to the processor 1901 or implemented by the processor 1901. The processor 1901 may be an integrated circuit chip having signal processing capabilities. In implementation, the steps of the method may be performed by integrated logic circuits of hardware or instructions in the form of software in the processor 1901. The processor 1901 may be a general-purpose processor (e.g., a microprocessor or a conventional processor), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA) or other programmable logic device, discrete gate, transistor logic device or discrete hardware component, and the processor 1901 may implement or execute the methods, steps and logic blocks disclosed in the embodiments of the present application.
The steps of the method disclosed in connection with the embodiments of the present application may be directly implemented by a hardware decoding processor, or implemented by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium mature in the field, such as a random access memory, a read-only memory, a programmable read-only memory, or a charged erasable programmable memory (EEPROM). The storage medium is located in the memory 1904, and the processor 1901 reads the information in the memory 1904 and completes the steps of the method in combination with the hardware thereof.
Communication among the processor 1901, memory 1904, and communication interface 1903 may be via communication lines 1902.
In the above embodiments, the instructions stored by the memory for execution by the processor may be implemented in the form of a computer program product. The computer program product may be written in the memory in advance, or may be downloaded in the form of software and installed in the memory.
Embodiments of the present application also provide a computer program product comprising one or more computer instructions. The procedures or functions according to the embodiments of the present application are all or partially generated when the computer program instructions are loaded and executed on a computer. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored on a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL), or wireless (e.g., infrared, wireless, microwave, etc.) manner. DVD)), or a semiconductor medium (e.g., a Solid State Disk (SSD)), and the like.
An embodiment of the present application provides an electronic device, which includes a processor and a memory, where the memory is used to store a computer program, and the processor is used to execute the computer program to execute any one of the above message push methods.
The embodiment of the application also provides a computer readable storage medium. The methods described in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. Computer-readable media may include computer storage media and communication media, and may include any medium that can communicate a computer program from one place to another. A storage medium may be any target medium that can be accessed by a computer.
As one possible design, the computer-readable medium may include a compact disk read-only memory (CD-ROM), RAM, ROM, EEPROM, or other optical disk storage; the computer readable medium may include a disk memory or other disk storage device. Also, any connecting line may also be properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers.
Combinations of the above should also be included within the scope of computer-readable media. The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (13)

1. A message pushing method is applied to an electronic device, and comprises the following steps:
the electronic equipment plays a first video by running a video application; the video application belongs to a preset application;
the electronic equipment determines that the first video does not comprise subtitles, or acquires user behavior data corresponding to the identification of the target account within a first preset time period from a big data image platform under the condition that the subtitles included in the first video do not meet preset rules; the user behavior data comprises a first frequency and a second frequency; the first frequency is the frequency of the target account using the preset application; the second frequency is the frequency of using the subtitle function by the target account;
if the first frequency is greater than a first threshold and the second frequency is less than a second threshold, the electronic device displays a first notification message if exiting the video application, the first notification message for prompting a user to: and displaying the subtitles meeting the preset rule by using the subtitle function when a second video is played by using the preset application, wherein the second video is different from the first video.
2. The message pushing method according to claim 1, wherein the electronic device displays a first notification message if exiting the video application, comprising:
the electronic equipment displays the first notification message in a preset display form under the condition of exiting the video application; the preset display form comprises: any one of a banner display, a notification center display, or a dialog display.
3. The message pushing method according to claim 1 or 2, characterized in that a machine playing skill is included in the electronic device; the game skill comprises an operation method using the caption function; the first notification message includes: prompt information and a skip control related to the subtitle function; the method further comprises the following steps:
the electronic equipment receives a first trigger operation of a user for the jump control, and jumps to an operation method of using the subtitle function in the machine playing skill in response to the first trigger operation.
4. The message pushing method according to claim 3, characterized in that the method further comprises: when the second frequency is greater than a second threshold, the electronic device determines that the second video does not include subtitles when playing the second video through the preset application, or the subtitles included in the second video do not meet the preset rule;
and when the electronic equipment plays the second video through the preset application, the subtitle function is used for displaying the subtitles meeting the preset rule.
5. The message pushing method according to claim 1 or 2, wherein the first notification message comprises: prompt information and control related to the subtitle function; the method further comprises the following steps:
and the electronic equipment receives a second trigger operation of the user for the control, and responds to the second trigger operation, the electronic equipment displays the subtitles meeting the preset rule by using the subtitle function when the second video is played through the video application.
6. The message pushing method according to claim 4, wherein a computing engine and a perception service are operated in the electronic device; registering a video playing event of the preset application in the sensing service; when the electronic device plays the second video through the preset application, determining that the second video does not include subtitles, or that the subtitles included in the second video do not satisfy the preset rule, the method includes:
when the perception service monitors that the preset application plays the second video, the calculation engine performs subtitle detection on the second video through a subtitle detection algorithm;
in the case that the calculation engine does not detect subtitles within a second preset time period, the calculation engine determines that the second video does not include subtitles;
when the calculation engine detects the subtitles of the second video within the second preset time period, the calculation engine identifies the language of the subtitles, and when the language of the subtitles is the first language and the system language of the electronic device acquired by the calculation engine is the second language, the calculation engine determines that the subtitles included in the second video do not satisfy the preset rule.
7. The message pushing method according to claim 1 or 2, wherein the step of acquiring, by the electronic device, user behavior data corresponding to the identifier of the target account within the first preset time period from the big data imaging platform includes:
the electronic equipment sends a first request message to the big data image platform; the first request message includes an identification of the target account; the first request message is used for acquiring the user behavior data of the target account;
the electronic device receives the user behavior data sent from the big data representation platform.
8. The message pushing method according to claim 1 or 2, characterized in that the method further comprises:
under the condition that the electronic equipment monitors that the video application is opened, the electronic equipment sends a record of using the video application to the big data representation platform; the record includes an identification of the target account; and the record is used for the big data image platform to update the user behavior data of the target account.
9. The message pushing method according to claim 3, wherein a computing engine, an intelligent reminder and a notification bar are operated in the electronic device; the electronic device displays the first notification message in a preset display form under the condition of exiting the video application, and the method comprises the following steps:
the computing engine sends a push indication message to the intelligent reminder when the electronic device exits the video application; the intelligent reminder sends a recommendation notification to the notification bar according to the push indication message; and the notification bar pushes the first notification message.
10. The message pushing method according to claim 3, wherein a computing engine, an intelligent reminder and an artificial intelligence subtitle application are running in the electronic device; the electronic device displays the first notification message in a preset display form under the condition of exiting the video application, and the method comprises the following steps:
the computing engine sends a push indication message to the intelligent reminder when the electronic device exits the video application; the intelligent reminder sends a recommendation notification to the artificial intelligent subtitle application according to the push indication message; the artificial intelligence subtitle application displays the first notification message through a dialog box.
11. An electronic device, comprising a processing module and a display module;
the processing module is used for: playing a first video by running a video application; the video application belongs to a preset application; determining that the first video does not include subtitles, or acquiring user behavior data corresponding to the identification of the target account within a first preset time period from a big data image platform under the condition that the subtitles included in the first video do not meet preset rules; the user behavior data comprises a first frequency and a second frequency; the first frequency is the frequency of the target account using the preset application; the second frequency is the frequency of using the subtitle function by the target account;
the display module is used for: if the first frequency is greater than a first threshold and the second frequency is less than a second threshold, the electronic device displays a first notification message if exiting the video application, the first notification message for prompting a user to: and displaying the subtitles meeting the preset rule by using the subtitle function when a second video is played by using the preset application, wherein the second video is different from the first video.
12. An electronic device, comprising: a memory for storing a computer program and a processor for executing the computer program to cause the electronic device to perform the message push method of any of claims 1 to 10.
13. A computer-readable storage medium storing instructions that, when executed, cause a computer to perform the message pushing method of any one of claims 1 to 10.
CN202210112107.XA 2022-01-29 2022-01-29 Message pushing method and device and storage medium Active CN114120211B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210112107.XA CN114120211B (en) 2022-01-29 2022-01-29 Message pushing method and device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210112107.XA CN114120211B (en) 2022-01-29 2022-01-29 Message pushing method and device and storage medium

Publications (2)

Publication Number Publication Date
CN114120211A CN114120211A (en) 2022-03-01
CN114120211B true CN114120211B (en) 2022-07-08

Family

ID=80361827

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210112107.XA Active CN114120211B (en) 2022-01-29 2022-01-29 Message pushing method and device and storage medium

Country Status (1)

Country Link
CN (1) CN114120211B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116056002B (en) * 2022-08-17 2023-09-22 荣耀终端有限公司 Data acquisition method and electronic equipment

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105657497A (en) * 2016-02-01 2016-06-08 华为技术有限公司 Video playing method and equipment
WO2019117884A1 (en) * 2017-12-13 2019-06-20 Google Llc Methods, systems, and media for presenting caption information based on volume setting adjustments
WO2020256424A1 (en) * 2019-06-18 2020-12-24 Samsung Electronics Co., Ltd. Method and apparatus for managing operations on data presented on a display

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110297621A (en) * 2019-05-22 2019-10-01 深圳壹账通智能科技有限公司 Method, apparatus, equipment and the storage medium of application message notice management
CN111405030B (en) * 2020-03-12 2021-08-10 腾讯科技(深圳)有限公司 Message pushing method and device, electronic equipment and storage medium
CN112684967A (en) * 2021-03-11 2021-04-20 荣耀终端有限公司 Method for displaying subtitles and electronic equipment
CN113434643A (en) * 2021-05-20 2021-09-24 华为技术有限公司 Information recommendation method and related equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105657497A (en) * 2016-02-01 2016-06-08 华为技术有限公司 Video playing method and equipment
WO2019117884A1 (en) * 2017-12-13 2019-06-20 Google Llc Methods, systems, and media for presenting caption information based on volume setting adjustments
WO2020256424A1 (en) * 2019-06-18 2020-12-24 Samsung Electronics Co., Ltd. Method and apparatus for managing operations on data presented on a display

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
弹幕视频播放量影响因素与组态效应;陈明红 等;《图书馆论坛》;20211208;第1-14页 *

Also Published As

Publication number Publication date
CN114120211A (en) 2022-03-01

Similar Documents

Publication Publication Date Title
CN109559270B (en) Image processing method and electronic equipment
CN111314775B (en) Video splitting method and electronic equipment
CN114255745A (en) Man-machine interaction method, electronic equipment and system
CN113837984A (en) Playback abnormality detection method, electronic device, and computer-readable storage medium
CN115422480B (en) Method, apparatus and storage medium for determining region of event venue
CN116431855B (en) Image retrieval method and related equipment
CN114120211B (en) Message pushing method and device and storage medium
CN114330374A (en) Fusion scene perception machine translation method, storage medium and electronic equipment
CN113672420B (en) Fault detection method and electronic equipment
WO2021031862A1 (en) Data processing method and apparatus thereof
CN112269554B (en) Display system and display method
CN114756785A (en) Page display method and device, electronic equipment and readable storage medium
CN115525783B (en) Picture display method and electronic equipment
CN115686182B (en) Processing method of augmented reality video and electronic equipment
CN113760191B (en) Data reading method, data reading apparatus, storage medium, and program product
CN114710459B (en) Chat interaction method, electronic equipment and server
CN116861066A (en) Application recommendation method and electronic equipment
CN115700451A (en) Service recommendation method and electronic equipment
CN115883893A (en) Cross-device flow control method and device for large-screen service
CN115695860A (en) Method for recommending video clip, electronic device and server
CN116028707B (en) Service recommendation method, device and storage medium
CN116738073B (en) Method, equipment and storage medium for identifying residence
CN115841099B (en) Intelligent recommendation method of page filling words based on data processing
CN116055613B (en) Screen projection method and device
CN114115772B (en) Method and device for off-screen display

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant