CN108769362B - Unread message prompting method of application program and related product - Google Patents

Unread message prompting method of application program and related product Download PDF

Info

Publication number
CN108769362B
CN108769362B CN201810327028.4A CN201810327028A CN108769362B CN 108769362 B CN108769362 B CN 108769362B CN 201810327028 A CN201810327028 A CN 201810327028A CN 108769362 B CN108769362 B CN 108769362B
Authority
CN
China
Prior art keywords
picture
operation result
unread message
picture blocks
blocks
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201810327028.4A
Other languages
Chinese (zh)
Other versions
CN108769362A (en
Inventor
陈岩
刘耀勇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201810327028.4A priority Critical patent/CN108769362B/en
Publication of CN108769362A publication Critical patent/CN108769362A/en
Application granted granted Critical
Publication of CN108769362B publication Critical patent/CN108769362B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72469User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
    • H04M1/72472User interfaces specially adapted for cordless or mobile telephones for operating the device by selecting functions from two or more displayed items, e.g. menus or icons wherein the items are sorted according to specific criteria, e.g. frequency of use
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72484User interfaces specially adapted for cordless or mobile telephones wherein functions are triggered by incoming communication events
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04803Split screen, i.e. subdividing the display area or the window area into separate subareas
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/22Details of telephonic subscriber devices including a touch pad, a touch sensor or a touch detector

Landscapes

  • Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Telephone Function (AREA)

Abstract

The application provides an unread message prompt method of an application program and a related product, comprising the following steps: intercepting a display picture of the touch display screen, and cutting the display picture according to a set size to obtain a plurality of picture blocks; acquiring app names corresponding to the picture blocks, sequentially inputting the picture blocks into a preset neural network model for forward operation to obtain an operation result corresponding to each picture block, determining whether the picture blocks corresponding to the operation result have unread messages according to the operation result, and adding the app names corresponding to the picture blocks with the unread messages into an unread message list; and displaying the unread message list. The technical scheme provided by the application has the advantage of high user experience.

Description

Unread message prompting method of application program and related product
Technical Field
The present application relates to the field of communications and terminals, and in particular, to an unread message notification method for an application and a related product.
Background
In the prior art, mobile terminals (such as mobile phones, tablet computers, etc.) have become electronic devices preferred and most frequently used by users. With the popularization of smart phones, interaction between people and the mobile phones is more and more diversified, the smart phones are rapidly popularized by installing application programs (apps), each app has an independent message for the apps, the existing unread message prompt only reminds the apps from a single app icon, and for users, the unread messages of all apps cannot be conveniently seen, so that the user experience is affected.
Content of application
The embodiment of the application provides an unread message prompt method and a related product of an application program, which can display all apps in the unread message in an intelligent terminal, facilitate a user to watch all apps of the unread message, and improve user experience.
In a first aspect, an embodiment of the present application provides an electronic device, including: a touch-sensitive display screen and an application processor AP,
the AP is used for intercepting a display picture of the touch display screen and cutting the display picture according to a set size to obtain a plurality of picture blocks;
the AP is used for acquiring app names corresponding to the picture blocks, sequentially inputting the picture blocks into a preset neural network model for forward operation to obtain an operation result corresponding to each picture block, determining whether the picture blocks corresponding to the operation result have unread messages according to the operation result, and adding the app names corresponding to the picture blocks with the unread messages into an unread message list;
the AP is further used for controlling the touch display screen to display the unread message list.
In a second aspect, an unread message notification method for an application is provided, where the method is applied to an electronic device, and the electronic device includes: a touch display screen; the method comprises the following steps:
the touch control display screen is used for intercepting a display picture of the touch control display screen and cutting the display picture according to a set size to obtain a plurality of picture blocks;
acquiring app names corresponding to the picture blocks, sequentially inputting the picture blocks into a preset neural network model for forward operation to obtain an operation result corresponding to each picture block, determining whether the picture blocks corresponding to the operation result have unread messages according to the operation result, and adding the app names corresponding to the picture blocks with the unread messages into an unread message list;
and displaying the unread message list.
In a third aspect, an intelligent terminal is provided, which includes: a touch-sensitive display screen and a processor,
the processor is used for intercepting a display picture of the touch display screen and cutting the display picture according to a set size to obtain a plurality of picture blocks;
the processor is configured to acquire app names corresponding to the plurality of picture blocks, sequentially input the plurality of picture blocks into a preset neural network model to perform forward operation to obtain an operation result corresponding to each picture block, determine whether an unread message exists in the picture block corresponding to the operation result according to the operation result, and add the app names corresponding to the picture blocks with the unread message into an unread message list;
the processor is further configured to control the touch display screen to display the unread message list.
In a fourth aspect, a computer-readable storage medium is provided, which stores a computer program for electronic data exchange, wherein the computer program causes a computer to perform the method provided in the second aspect.
In a fifth aspect, there is provided a computer program product comprising a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform the method provided by the second aspect.
The embodiment of the application has the following beneficial effects:
the electronic device provided by the application can be seen that the display picture of the touch display screen is intercepted, then the display picture is cut into a plurality of picture blocks, then the picture blocks are used as input data and input into a preset neural network model to carry out forward operation to obtain an operation result of the forward operation, whether the picture block has unread information or not is determined according to the operation result, if the picture block has the unread information, the name of the app is added into an unread message list, and therefore a user can recognize application programs of the unread information of all pages from the unread message list, and experience of the user is improved.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the description of the embodiments are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts.
Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
Fig. 1a is a schematic diagram of a display picture according to an embodiment of the present disclosure.
Fig. 1b is a schematic diagram of another display picture provided in the embodiment of the present application.
Fig. 2 is a schematic view of an electronic device disclosed in an embodiment of the present application.
Fig. 2a is a schematic diagram of data insertion provided in an embodiment of the present application.
Fig. 2b is a schematic distribution diagram of forward operation results provided in the embodiment of the present application.
Fig. 3 is a flowchart illustrating an unread message notification method for an application according to an embodiment of the present disclosure.
Fig. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Fig. 5 is a schematic structural diagram of a mobile phone disclosed in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms "first," "second," "third," and "fourth," etc. in the description and claims of this application and in the accompanying drawings are used for distinguishing between different objects and not for describing a particular order. Furthermore, the terms "include" and "have," as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements listed, but may alternatively include other steps or elements not listed, or inherent to such process, method, article, or apparatus.
Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the application. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
In the electronic device provided in the first aspect, the AP is further configured to sort the plurality of picture blocks according to positions of the plurality of picture blocks in a displayed picture, and sequentially input the plurality of picture blocks into a preset neural network model according to the order obtained by the sorting to perform forward operation, so as to obtain an operation result corresponding to each picture block.
In the electronic device provided in the first aspect, the AP is specifically configured to extract P values of a first picture block of the plurality of picture blocks, and compose the P values into input data CI1*H1*W1Inputting the data CI1*H1*W1Inputting the data into a preset neural network model to calculate to obtain a forward operation result, and obtaining whether an unread message exists according to the forward operation result, wherein CI1For depth values of the input data, H1For height values, W, of input data1Is the width value of the input data.
In the electronic device provided in the first aspect, the AP is specifically configured to extract X elements in the operation result, where the element values of the X elements are greater than a set threshold, for example, a position of the X elements having greater than X/2 elements is located in a first area, determine that the operation result is a message with unread corresponding to the first area, and for example, a position of the X elements not having greater than X/2 elements is located in the first area, determine that the operation result is a message with no unread.
In a method provided in the second aspect, before obtaining app names corresponding to the plurality of picture blocks, the method further includes:
and sequencing the picture blocks according to the positions of the picture blocks in the display picture.
In a method provided by the second aspect, sequentially inputting the plurality of picture blocks into a preset neural network model for forward operation to obtain an operation result corresponding to each picture block includes:
extracting P values of a first picture block of the plurality of picture blocks, composing the P values into input data CI1*H1*W1Inputting the data CI1*H1*W1Inputting the data into a preset neural network model to calculate to obtain a forward operation result, and obtaining whether an unread message exists according to the forward operation result, wherein CI1For depth values of the input data, H1For height values, W, of input data1Is the width value of the input data.
In a second aspect, the obtaining whether there is an unread message according to the forward operation result includes:
extracting X elements of which the element values are larger than a set threshold value in the operation result, if the position of the X elements with the elements larger than X/2 is located in a first area, determining that the operation result is the unread message corresponding to the first area, and if the position of the X elements without the elements larger than X/2 is located in the first area, determining that the operation result is the unread message.
The electronic device in the present application may include a smart Phone (e.g., an Android Phone, an iOS Phone, a Windows Phone, etc.), a tablet computer, a palm computer, a notebook computer, a Mobile Internet device (MID, Mobile Internet Devices), or a wearable device, and the electronic Devices are merely examples, but not exhaustive, and include but are not limited to the electronic Devices, and for convenience of description, the electronic Devices are referred to as User Equipment (UE) in the following embodiments. Of course, in practical applications, the user equipment is not limited to the above presentation form, and may also include: smart televisions, home robots, computer devices, and the like.
Referring to fig. 1, fig. 1 is a schematic view of an electronic device according to an embodiment of the present disclosure, fig. 1 is a schematic view of an electronic device 100 according to an embodiment of the present disclosure, where the electronic device 100 includes: the touch display device comprises a shell 110, a circuit board 120, a battery 130, a cover plate 140, a touch display screen 150 and a transceiver 180, wherein the circuit board 120, the battery 130 and the cover plate 140 are arranged on the shell 110, and the circuit board 120 is also provided with a circuit connected with the touch display screen 150; the circuit board 120 may further include: the application processor AP 190. The electronic device 100 further has a plurality of app icons installed therein, and the app icons are shown in fig. 1a, that is, a single app is displayed on the touch display screen 150 in the form of a single icon, and in actual applications, the app icons are shown in fig. 1b, that is, a single app is displayed on the touch display screen 150 in the form of a single icon and a plurality of apps are displayed in a set.
As shown in fig. 1b, what is displayed in a set manner for a plurality of apps, which may also be referred to as a folder manner, is that the app has an unread message, which cannot be seen, which is very inconvenient for the user and affects the user experience.
The transceiver 180 may be different transceivers according to different types of electronic devices, for example, if the electronic device is a mobile phone, the transceiver may be a wireless transceiver, if the electronic device is a smart tv, and the transceiver may be a network port.
The touch Display screen may be a Thin Film Transistor-Liquid Crystal Display (TFT-LCD), a Light Emitting Diode (LED) Display screen, an Organic Light Emitting Diode (OLED) Display screen, or the like.
Referring to fig. 2, fig. 2 is an electronic device provided in the present application, and as shown in fig. 2, the electronic device may include: a touch display screen 203, an application processor AP202, and a transceiver 201; the touch display 203 and the transceiver 201 are connected to the AP202 through at least one circuit 204 (e.g., a bus 204); optionally, other sensors may be disposed within the electronic device, including but not limited to: cameras, gravity sensors, distance sensors, speakers, etc.
The AP202 is used for intercepting a display picture of the touch display screen and cutting the display picture according to a set size to obtain a plurality of picture blocks patch;
the manner of capturing the display picture of the touch display screen by the AP may be multiple, for example, the display image of the touch display screen may be directly captured from the output to obtain the display picture, and in another optional technical scheme, the capturing of the display picture of the touch display screen may also be triggering of a capture command to capture the display picture of the touch display screen.
Before intercepting the display picture of the touch display screen, the AP202 may further include:
determining that a currently displayed page of the touch display screen contains a plurality of app icons.
The above manner of cutting the display picture according to the set size to obtain the plurality of picture blocks may specifically include:
in an optional technical solution, the display picture is divided into a plurality of picture blocks by the set grid method, where the size of each grid is the set size, and specifically, the size of the grid is preferably selected to be square.
In another optional technical scheme, a display format of apps of the touch display screen is determined, a distance between the apps is determined according to the display format and the size of an app icon, the set size is determined as the size of the app icon plus the distance, and a display picture is cut according to the set size to obtain a plurality of picture blocks.
In another optional technical scheme, the display picture is identified to determine a first area with the app and a second area without the app, the first area is cut into a plurality of picture blocks according to a set size, and the second area is deleted.
The AP202 is configured to obtain app names corresponding to a plurality of picture blocks, sequentially input the plurality of picture blocks into a preset neural network model to perform forward operation to obtain an operation result corresponding to each picture block, determine whether an unread message exists in the picture block corresponding to the operation result according to the operation result, and add the app name corresponding to the picture block with the unread message into an unread message list.
Optionally, the AP202 is further configured to sort the plurality of picture blocks according to the positions of the display pictures.
The above-mentioned ordering rule may be any rule, for example, the tiles may be arranged in a positive order from left to right and from top to bottom according to the positions of the tiles in the display image, and in practical applications, the tiles may also be arranged in a negative order from left to right and from top to bottom according to the positions of the tiles in the display image. The present application is not intended to be limited to the specific manner of sorting described above.
The AP202 is further configured to control the touch display screen to display the unread message list.
The electronic device provided by the application intercepts the display picture of the touch display screen, then cuts the display picture to form a plurality of picture blocks, then inputs the picture blocks as input data into a preset neural network model to perform forward operation to obtain an operation result of the forward operation, and determines whether the picture block has unread information or not according to the operation result, if the picture block has the unread information, the name of the app is added into an unread message list, so that a user can recognize the application programs of the unread information of all pages from the unread message list, and the experience degree of the user is improved.
Alternatively to this, the first and second parts may,
AP202, specifically configured to extract P values (e.g. gray values, coordinate values, etc.) of a first picture block of the plurality of picture blocks, and compose the P values into input data CI1*H1*W1Inputting the data CI1*H1*W1Inputting the data into a preset neural network model to calculate to obtain a forward operation result, and obtaining whether an unread message exists according to the forward operation result, wherein CI1For depth values of the input data, H1For height values, W, of input data1Is the width value of the input data.
AP202, specifically for obtaining an initial matrix CI in a preset neural network model0*H0*W0(ii) a E.g. P ═ CI0*H0*W0When/2, the P values are combined into a matrix CI0*H0/2*W0Will matrix CI0*H0/2*W0Inserting data CI for every other row in H direction0*W0Obtaining an input matrix CI0*H0*W0(CI1=CI0、H1=H0、W1=W0),CI0*W0The data is the average of two elements adjacent in the H direction. Specifically, if the data of the H-direction 2 nd line is inserted, the inserted data is an average value of the H-direction 1 st line and the H-direction 3 rd line. The above CI0*H0*W0The value may specifically be a preset value of the neural network model (the preset value may be determined by sample training or may be set by a user), and specifically, the value of the CI corresponding to the neural network model is0H W may be: CI0=16;H0=32;W020. Of course, in practical application, CI can also be adopted0、H0、W0Other values are possible, e.g. CI0=32;H0=64;W020. The present application does not limit the above CI0、H0、W0The specific value of (a).
This solution increases the number of elements of the input data matrix by inserting data, which may make the number of elements of the input matrix closest to the value of the elements of the initial input matrix, specifically, as shown in fig. 2a, the inserted data is shown in fig. 2 a. The inserted data is the average value of the adjacent rows, as indicated by the arrows in fig. 2a, and if the inserted data is the last row, the inserted data may be the values of the adjacent rows. As shown in fig. 2a, where (H1+ H2)/2 represents an average value between the first row and the second row in the H-insertion direction. Where H1 denotes the value of the first row in the H direction, H2 denotes the value of the second row, and the arrow in fig. 2a denotes the insertion of data directly into the corresponding row. As shown in fig. 2a, the manner of inserting data is exemplified by the data of row 2 and the data of the last row, and for the manner of inserting data of the middle row, the manner of inserting data of row 2 can be referred to for implementation.
The AP202 is specifically configured to extract X elements in the operation result, where the element values of the X elements are greater than a set threshold, for example, a position of the X elements having greater than X/2 elements is located in a first area, and determine that the operation result is an unread message corresponding to the first area, and for example, a position of the X elements not having greater than X/2 elements is located in the first area, and determine that the operation result is not an unread message.
Specifically, referring to fig. 2b, fig. 2b shows the result of a forward operation (where the black boxes may be located at X elements), which may be a 3-dimensional result matrix, for which the basis is that, for 2 parameters (with and without unread messages), which are divided into different regions in the 3-dimensional result matrix, such that if the calculated 3-dimensional result matrix has a greater number of elements in the corresponding region that exceed a set threshold, the greater the probability that the corresponding parameter of the region is, for example, the number of elements in a first region of an unread message that exceeds a set sum is greater than the number of elements in a second region without unread messages, whereas if the number of elements in the corresponding region that exceeds a set threshold is smaller, the probability of the corresponding parameter for the region is smaller, so the 3-dimensional result matrix CI is used first.2*H2*W2Inquiring X elements which are larger than a set threshold value, determining an area to which the X positions belong according to the X positions of the X elements, if the number of the elements of the first area exceeds X/2, determining that the forward operation result is provided with unread messages, otherwise, if the number of the elements of the first area is smaller than X/2, determining that the forward operation structure is not provided with unread messages.
Referring to fig. 3, fig. 3 provides an unread message notification method for an application, where the method is applied in an electronic device, and the structure of the electronic device is as shown in fig. 1 or fig. 2, and the method includes the following steps:
s301, acquiring a display picture of a captured touch display screen, and cutting the display picture according to a set size to obtain a plurality of picture blocks patch;
the manner of capturing the display picture of the touch display screen may be various, for example, the display image of the touch display screen may be directly captured from the output to obtain the display picture, and in another optional technical solution, the capturing of the display picture of the touch display screen may also be triggering of a capture command to capture the display picture of the touch display screen.
The capturing the display picture of the touch display screen may further include:
determining that a currently displayed page of the touch display screen contains a plurality of app icons.
The above manner of cutting the display picture according to the set size to obtain the plurality of picture blocks may specifically include:
in an optional technical solution, the display picture is divided into a plurality of picture blocks by the set grid method, where the size of each grid is the set size, and specifically, the size of the grid is preferably selected to be square.
In another optional technical scheme, a display format of apps of the touch display screen is determined, a distance between the apps is determined according to the display format and the size of an app icon, the set size is determined as the size of the app icon plus the distance, and a display picture is cut according to the set size to obtain a plurality of picture blocks.
In another optional technical scheme, the display picture is identified to determine a first area with the app and a second area without the app, the first area is cut into a plurality of picture blocks according to a set size, and the second area is deleted.
Step S302, acquiring a plurality of picture blocks according to corresponding app names, sequentially inputting the picture blocks into a preset neural network model for forward operation to obtain an operation result corresponding to each picture block, determining whether the picture block corresponding to the operation result has unread messages according to the operation result, and adding the app names corresponding to the picture blocks with the unread messages into an unread message list;
optionally, before acquiring the plurality of pictures, the method further includes: and sorting the plurality of picture blocks according to the positions of the display pictures.
The above-mentioned ordering rule may be any rule, for example, the tiles may be arranged in a positive order from left to right and from top to bottom according to the positions of the tiles in the display image, and in practical applications, the tiles may also be arranged in a negative order from left to right and from top to bottom according to the positions of the tiles in the display image. The present application is not intended to be limited to the specific manner of sorting described above.
And step S303, displaying the unread message list.
The electronic device provided by the application intercepts the display picture of the touch display screen, then cuts the display picture to form a plurality of picture blocks, then inputs the picture blocks as input data into a preset neural network model to perform forward operation to obtain an operation result of the forward operation, and determines whether the picture block has unread information or not according to the operation result, if the picture block has the unread information, the name of the app is added into an unread message list, so that a user can recognize the application programs of the unread information of all pages from the unread message list, and the experience degree of the user is improved.
Optionally, the multiple picture blocks are sequentially input into a preset neural network model for forward operation to obtain an operation result corresponding to each picture block, and the method specifically includes:
extracting P values of a first picture block of the plurality of picture blocks, composing the P values into input data CI1*H1*W1Inputting the data CI1*H1*W1Inputting the data into a preset neural network model to calculate to obtain a forward operation result, and obtaining whether an unread message exists according to the forward operation result, wherein CI1For depth values of the input data, H1For height values, W, of input data1Is the width value of the input data.
Optionally, the P values are combined into input data CI1*H1*W1The method specifically comprises the following steps:
obtaining an initial matrix CI in a preset neural network model0*H0*W0(ii) a E.g. P ═ CI0*H0*W0When/2, the P values are combined into a matrix CI0*H0/2*W0Will matrix CI0*H0/2*W0Inserting data CI for every other row in H direction0*W0Obtaining an input matrix CI0*H0*W0(CI1=CI0、H1=H0、W1=W0) The data is the average of two elements adjacent in the H direction. Specifically, if the data of the H-direction 2 nd line is inserted, the inserted data is an average value of the H-direction 1 st line and the H-direction 3 rd line. The above CI0*H0*W0The value may specifically be a preset value of the neural network model (the preset value may be determined by sample training or may be set by a user), and specifically, the value of the CI corresponding to the neural network model is0H W may be: CI0=16;H0=32;W020. Of course, in practical application, CI can also be adopted0、H0、W0Other values are possible, e.g. CI0=32;H0=64;W020. The present application does not limit the above CI0、H0、W0The specific value of (a).
Referring to fig. 4, fig. 4 provides an electronic device including: the touch display screen 402, the transceiver 404 and the processing unit 401 may be connected by a bus, and of course, in practical applications, other connection manners may also be adopted, and the present application does not limit the specific representation form of the connection.
The processing unit 401 is configured to intercept a display picture of the touch display screen, and cut the display picture according to a set size to obtain a plurality of picture blocks patch;
the processor may capture the display image of the touch display screen in a variety of ways, for example, the display image of the touch display screen may be directly captured from the output to obtain the display image, and in another optional technical solution, the capturing of the display image of the touch display screen may also be triggering of a capture command to capture the display image of the touch display screen.
The processor may further include, before intercepting a display picture of the touch display screen:
determining that a currently displayed page of the touch display screen contains a plurality of app icons.
The above manner of cutting the display picture according to the set size to obtain the plurality of picture blocks may specifically include:
in an optional technical solution, the display picture is divided into a plurality of picture blocks by the set grid method, where the size of each grid is the set size, and specifically, the size of the grid is preferably selected to be square.
In another optional technical scheme, a display format of apps of the touch display screen is determined, a distance between the apps is determined according to the display format and the size of an app icon, the set size is determined as the size of the app icon plus the distance, and a display picture is cut according to the set size to obtain a plurality of picture blocks.
In another optional technical scheme, the display picture is identified to determine a first area with the app and a second area without the app, the first area is cut into a plurality of picture blocks according to a set size, and the second area is deleted.
The processing unit 401 is configured to obtain a plurality of picture blocks according to corresponding app names, sequentially input the plurality of picture blocks into a preset neural network model for forward operation to obtain an operation result corresponding to each picture block, determine whether an unread message exists in the picture block corresponding to the operation result according to the operation result, and add the app name corresponding to the picture block with the unread message into an unread message list.
Optionally, the processing unit 401 is further configured to sort the plurality of picture blocks according to the positions of the display pictures.
The above-mentioned ordering rule may be any rule, for example, the tiles may be arranged in a positive order from left to right and from top to bottom according to the positions of the tiles in the display image, and in practical applications, the tiles may also be arranged in a negative order from left to right and from top to bottom according to the positions of the tiles in the display image. The present application is not intended to be limited to the specific manner of sorting described above.
The processing unit 401 controls the touch display screen to display the unread message list.
The electronic device provided by the application intercepts the display picture of the touch display screen, then cuts the display picture to form a plurality of picture blocks, then inputs the picture blocks as input data into a preset neural network model to perform forward operation to obtain an operation result of the forward operation, and determines whether the picture block has unread information or not according to the operation result, if the picture block has the unread information, the name of the app is added into an unread message list, so that a user can recognize the application programs of the unread information of all pages from the unread message list, and the experience degree of the user is improved.
Fig. 5 is a block diagram illustrating a partial structure of a mobile phone related to a mobile terminal provided in an embodiment of the present application. Referring to fig. 5, the handset includes: radio Frequency (RF) circuit 910, memory 920, input unit 930, sensor 950, audio collector 960, Wireless Fidelity (WiFi) module 970, application processor AP980, and power supply 990. Those skilled in the art will appreciate that the handset configuration shown in fig. 5 is not intended to be limiting and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.
The following describes each component of the mobile phone in detail with reference to fig. 5:
the input unit 930 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the cellular phone. Specifically, the input unit 930 may include a touch display screen 933, a fingerprint recognition apparatus 931, a face recognition apparatus 936, an iris recognition apparatus 937, and other input devices 932. The input unit 930 may also include other input devices 932. In particular, other input devices 932 may include, but are not limited to, one or more of physical keys, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like. Wherein the content of the first and second substances,
the AP980 is used for intercepting a display picture of the touch display screen and cutting the display picture according to a set size to obtain a plurality of picture blocks patch;
and the AP980 is used for acquiring a plurality of picture blocks according to corresponding app names, sequentially inputting the picture blocks into a preset neural network model for forward operation to obtain an operation result corresponding to each picture block, determining whether the picture block corresponding to the operation result has an unread message according to the operation result, and adding the app names corresponding to the picture blocks with the unread message into the unread message list.
And the AP980 controls the touch display screen to display the unread message list.
AP980, in particular for extracting P values of a first picture block of the plurality of picture blocks, composing the P values into input data CI1*H1*W1Inputting the data CI1*H1*W1Inputting the data into a preset neural network model to calculate to obtain a forward operation result, and obtaining whether an unread message exists according to the forward operation result, wherein CI1For depth values of the input data, H1For height values, W, of input data1Is the width value of the input data.
AP980, specifically for obtaining initial matrix CI in preset neural network model0*H0*W0(ii) a E.g. P ═ CI0*H0*W0When/2, the P values are combined into a matrix CI0*H0/2*W0Will matrix CI0*H0/2*W0Inserting data CI for every other row in H direction0*W0Obtaining an input matrix CI0*H0*W0(CI1=CI0、H1=H0、W 1=W 0) The data is the average of two elements adjacent in the H direction. Specifically, if the data of the H-direction 2 nd line is inserted, the inserted data is an average value of the H-direction 1 st line and the H-direction 3 rd line. The above CI0*H0*W0The value may specifically be a preset value of the neural network model (the preset value may be determined by sample training or may be set by a user), and specifically, the value of the CI corresponding to the neural network model is0H W may be: CI0=16;H0=32;W020. Of course, in practical application, CI can also be adopted0、H0、W0Other values are possible, e.g. CI0=32;H0=64;W0=20。The present application does not limit the above CI0、H0、W0The specific value of (a).
The AP202 is specifically configured to extract X elements in the operation result, where the element values of the X elements are greater than a set threshold, for example, a position of the X elements having greater than X/2 elements is located in a first area, and determine that the operation result is an unread message corresponding to the first area, and for example, a position of the X elements not having greater than X/2 elements is located in the first area, and determine that the operation result is not an unread message.
The AP980 is a control center of the mobile phone, connects various parts of the entire mobile phone by using various interfaces and lines, and performs various functions and processes of the mobile phone by operating or executing software programs and/or modules stored in the memory 920 and calling data stored in the memory 920, thereby integrally monitoring the mobile phone. Optionally, AP980 may include one or more processing units; alternatively, the AP980 may integrate an application processor that handles primarily the operating system, user interface, and applications, etc., and a modem processor that handles primarily wireless communications. It will be appreciated that the modem processor described above may not be integrated into the AP 980.
Further, the memory 920 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
RF circuitry 910 may be used for the reception and transmission of information. In general, the RF circuit 910 includes, but is not limited to, an antenna, at least one Amplifier, a transceiver, a coupler, a Low Noise Amplifier (LNA), a duplexer, and the like. In addition, the RF circuit 910 may also communicate with networks and other devices via wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to Global System for Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), and the like.
The handset may also include at least one sensor 950, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the touch display screen according to the brightness of ambient light, and the proximity sensor may turn off the touch display screen and/or the backlight when the mobile phone moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.
Audio collector 960, speaker 961, microphone 962 may provide an audio interface between the user and the handset. The audio collector 960 can transmit the received electrical signal converted from the audio data to the speaker 961, and the audio data is converted into a sound signal by the speaker 961 for playing; on the other hand, the microphone 962 converts the collected sound signal into an electrical signal, and the electrical signal is received by the audio collector 960 and converted into audio data, and then the audio data is processed by the audio data playing AP980, and then the audio data is sent to another mobile phone through the RF circuit 910, or the audio data is played to the memory 920 for further processing.
WiFi belongs to short-distance wireless transmission technology, and the mobile phone can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 970, and provides wireless broadband Internet access for the user. Although fig. 5 shows the WiFi module 970, it is understood that it does not belong to the essential constitution of the handset, and can be omitted entirely as needed within the scope of not changing the essence of the application.
The handset also includes a power supply 990 (e.g., a battery) for supplying power to various components, and optionally, the power supply may be logically connected to the AP980 via a power management system, so that functions of managing charging, discharging, and power consumption are implemented via the power management system.
Although not shown, the mobile phone may further include a camera, a bluetooth module, a light supplement device, a light sensor, and the like, which are not described herein again.
It can be seen that, according to the embodiment of the application, a display picture of the touch display screen is captured, the display picture is cut into a plurality of picture blocks, the picture blocks are input into a preset neural network model as input data to be subjected to forward operation to obtain an operation result of the forward operation, whether the picture block has unread information or not is determined according to the operation result, if the picture block has the unread information, the name of the app is added into an unread message list, and therefore a user can recognize application programs of the unread information of all pages from the unread message list, and experience of the user is improved. .
An embodiment of the present application further provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of the unread message notification method of any application program as described in the above method embodiments.
Embodiments of the present application also provide a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of the unread message alert method of any of the application programs described in the above method embodiments.
It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present application is not limited by the order of acts described, as some steps may occur in other orders or concurrently depending on the application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are exemplary embodiments and that the acts and modules referred to are not necessarily required in this application.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
In the embodiments provided in the present application, it should be understood that the disclosed apparatus may be implemented in other manners. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implementing, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection of some interfaces, devices or units, and may be an electric or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may be implemented in the form of a software program module.
The integrated units, if implemented in the form of software program modules and sold or used as stand-alone products, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be substantially implemented or a part of or all or part of the technical solution contributing to the prior art may be embodied in the form of a software product stored in a memory, and including several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method described in the embodiments of the present application. And the aforementioned memory comprises: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable memory, which may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.
The foregoing detailed description of the embodiments of the present application has been presented to illustrate the principles and implementations of the present application, and the above description of the embodiments is only provided to help understand the method and the core concept of the present application; meanwhile, for a person skilled in the art, according to the idea of the present application, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (11)

1. An electronic device, the electronic device comprising: a touch display screen and an application processor AP, characterized in that,
the AP is used for intercepting a display picture of the touch display screen and cutting the display picture according to a set size to obtain a plurality of picture blocks;
the AP is used for acquiring app names corresponding to the picture blocks, sequentially inputting the picture blocks into a preset neural network model for forward operation to obtain an operation result corresponding to each picture block, determining whether the picture blocks corresponding to the operation result have unread messages according to the operation result, and adding the app names corresponding to the picture blocks with the unread messages into an unread message list;
the AP is further used for controlling the touch display screen to display the unread message list.
2. The electronic device of claim 1,
and the AP is also used for sequencing the picture blocks according to the positions of the picture blocks at the display picture, and sequentially inputting the sequence obtained according to the sequencing into a preset neural network model to carry out forward operation so as to obtain an operation result corresponding to each picture block.
3. The electronic device of claim 1,
the AP is specifically configured to extract P values of a first picture block of the plurality of picture blocks, and compose the P values into input data CI1*H1*W1Inputting the data CI1*H1*W1Inputting the data into a preset neural network model to calculate to obtain a forward operation result, and obtaining whether an unread message exists according to the forward operation result, wherein CI1For depth values of the input data, H1For height values, W, of input data1Is the width value of the input data.
4. The electronic device of claim 3,
the AP is specifically configured to extract X elements of which element values are greater than a set threshold in an operation result, determine that the operation result is an unread message corresponding to a first area if a position of the X elements having elements greater than X/2 is located in the first area, and determine that the operation result is not an unread message if a position of the X elements not having elements greater than X/2 is located in the first area.
5. An unread message alert method for an application, the unread message alert method being applied to an electronic device, the electronic device comprising: a touch display screen; the method comprises the following steps:
intercepting a display picture of the touch display screen, and cutting the display picture according to a set size to obtain a plurality of picture blocks;
acquiring app names corresponding to the picture blocks, sequentially inputting the picture blocks into a preset neural network model for forward operation to obtain an operation result corresponding to each picture block, determining whether the picture blocks corresponding to the operation result have unread messages according to the operation result, and adding the app names corresponding to the picture blocks with the unread messages into an unread message list;
and displaying the unread message list.
6. The method according to claim 5, further comprising, before obtaining the app names corresponding to the plurality of picture blocks:
and sequencing the picture blocks according to the positions of the picture blocks in the display picture.
7. The method according to claim 5, wherein the sequentially inputting the plurality of picture blocks into a preset neural network model for forward operation to obtain an operation result corresponding to each picture block comprises:
extracting P values of a first picture block of the plurality of picture blocks, composing the P values into input data CI1*H1*W1Inputting the data CI1*H1*W1Inputting the data into a preset neural network model to calculate to obtain a forward operation result, and obtaining whether an unread message exists according to the forward operation result, wherein CI1For depth values of the input data, H1For height values, W, of input data1Is the width value of the input data.
8. The method of claim 7, wherein said deriving whether there is an unread message according to the result of the forward operation comprises:
extracting X elements of which the element values are larger than a set threshold value in the operation result, if the position of the X elements with the elements larger than X/2 is located in a first area, determining that the operation result is the unread message corresponding to the first area, and if the position of the X elements without the elements larger than X/2 is located in the first area, determining that the operation result is the unread message.
9. An intelligent terminal, the intelligent terminal comprising: touch display screen and processor, characterized by,
the processor is used for intercepting a display picture of the touch display screen and cutting the display picture according to a set size to obtain a plurality of picture blocks;
the processor is configured to acquire app names corresponding to the plurality of picture blocks, sequentially input the plurality of picture blocks into a preset neural network model to perform forward operation to obtain an operation result corresponding to each picture block, determine whether an unread message exists in the picture block corresponding to the operation result according to the operation result, and add the app names corresponding to the picture blocks with the unread message into an unread message list;
the processor is further configured to control the touch display screen to display the unread message list.
10. A computer-readable storage medium, characterized in that it stores a computer program for electronic data exchange, wherein the computer program causes a computer to perform the method according to any one of claims 5-8.
11. A computer program product, characterized in that the computer program product comprises a non-transitory computer readable storage medium storing a computer program operable to cause a computer to perform the method according to any of claims 5-8.
CN201810327028.4A 2018-04-12 2018-04-12 Unread message prompting method of application program and related product Expired - Fee Related CN108769362B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810327028.4A CN108769362B (en) 2018-04-12 2018-04-12 Unread message prompting method of application program and related product

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810327028.4A CN108769362B (en) 2018-04-12 2018-04-12 Unread message prompting method of application program and related product

Publications (2)

Publication Number Publication Date
CN108769362A CN108769362A (en) 2018-11-06
CN108769362B true CN108769362B (en) 2021-04-13

Family

ID=63981766

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810327028.4A Expired - Fee Related CN108769362B (en) 2018-04-12 2018-04-12 Unread message prompting method of application program and related product

Country Status (1)

Country Link
CN (1) CN108769362B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104461292A (en) * 2014-12-01 2015-03-25 深圳市东方拓宇科技有限公司 Unread message display method of intelligent terminal and corresponding intelligent terminal
CN106060247A (en) * 2016-05-19 2016-10-26 努比亚技术有限公司 Layout method and system of unread message desktop icons
CN107436937A (en) * 2017-07-25 2017-12-05 北京小米移动软件有限公司 Using the method and apparatus of installation
CN107566255A (en) * 2017-09-06 2018-01-09 叶进蓉 Unread message abstraction generating method and device
CN107864299A (en) * 2017-12-25 2018-03-30 广东欧珀移动通信有限公司 Image display method and Related product

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101466081A (en) * 2009-01-12 2009-06-24 中兴通讯股份有限公司 Method, system and terminal for associating terminal user information and picture
EP2348487A3 (en) * 2010-01-22 2017-09-13 Samsung Electronics Co., Ltd. Method and apparatus for creating animation message
WO2015130688A2 (en) * 2014-02-25 2015-09-03 Rupple Grace Lacinda License and certification compliance management system and method
CN104965580B (en) * 2014-05-08 2018-10-16 腾讯科技(深圳)有限公司 The methods of exhibiting and device of unread message
CN105739820A (en) * 2016-01-22 2016-07-06 努比亚技术有限公司 Message prompt display method and device
CN105867729B (en) * 2016-03-25 2019-05-10 努比亚技术有限公司 Message display device and method
US10318034B1 (en) * 2016-09-23 2019-06-11 Apple Inc. Devices, methods, and user interfaces for interacting with user interface objects via proximity-based and contact-based inputs
CN106412334A (en) * 2016-11-11 2017-02-15 努比亚技术有限公司 Notification message shielding device and method
CN106412339A (en) * 2016-11-29 2017-02-15 努比亚技术有限公司 Notification message processing method and apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104461292A (en) * 2014-12-01 2015-03-25 深圳市东方拓宇科技有限公司 Unread message display method of intelligent terminal and corresponding intelligent terminal
CN106060247A (en) * 2016-05-19 2016-10-26 努比亚技术有限公司 Layout method and system of unread message desktop icons
CN107436937A (en) * 2017-07-25 2017-12-05 北京小米移动软件有限公司 Using the method and apparatus of installation
CN107566255A (en) * 2017-09-06 2018-01-09 叶进蓉 Unread message abstraction generating method and device
CN107864299A (en) * 2017-12-25 2018-03-30 广东欧珀移动通信有限公司 Image display method and Related product

Also Published As

Publication number Publication date
CN108769362A (en) 2018-11-06

Similar Documents

Publication Publication Date Title
CN107967129B (en) Display control method and related product
CN107277230B (en) Voice broadcasting method of message and related product
CN107295173B (en) Method for deleting chat messages and related product
CN110209245B (en) Face recognition method and related product
CN108108137B (en) Display control method and related product
CN106528638B (en) Method for deleting backup data and mobile terminal
CN106569910B (en) Data backup and transmission method and mobile terminal
CN105094501B (en) Method, device and system for displaying messages in mobile terminal
CN107864299B (en) Picture display method and related product
CN107317918B (en) Parameter setting method and related product
CN108600887B (en) Touch control method based on wireless earphone and related product
CN107743108B (en) Method and device for identifying medium access control address
CN109189303B (en) Text editing method and mobile terminal
CN108564915B (en) Brightness adjusting method and related product
CN110191426B (en) Information sharing method and terminal
CN108121583B (en) Screen capturing method and related product
CN109151741B (en) Multimedia message receiving method and terminal
CN109960581B (en) Hardware resource allocation method and device, mobile terminal and storage medium
CN108877733B (en) Color temperature adjusting method and related device
CN107634940B (en) Flow use control method, terminal, server and readable storage medium
CN107566654B (en) Unlocking control method and related product
CN106844057B (en) Data processing method and device and mobile terminal
CN106792434B (en) Hotspot establishing method and terminal equipment
CN106293407B (en) Picture display method and terminal equipment
CN108234765B (en) Electronic equipment and related product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210413

CF01 Termination of patent right due to non-payment of annual fee