CN117523761A

CN117523761A - Data processing method and related device

Info

Publication number: CN117523761A
Application number: CN202311511472.9A
Authority: CN
Inventors: 余承富
Original assignee: Shenzhen Haique Technology Co ltd
Current assignee: Shenzhen Haique Technology Co ltd
Priority date: 2023-11-10
Filing date: 2023-11-10
Publication date: 2024-02-06

Abstract

The embodiment of the application discloses a data processing method and a related device, wherein the method comprises the following steps: acquiring target image data at a target reminding time, wherein the target image data comprises image information in an intelligent doorbell monitoring area; determining whether all households associated with the intelligent doorbell enter home according to the target image data; if the analysis result is that the whole person enters home, a safety prompt prompting the user to execute the antitheft measure is sent to at least one of the intelligent doorbell or the terminal equipment; if the analysis result is that the person does not enter home, sending a home inquiry message to at least one of the intelligent doorbell or the terminal equipment, and updating target reminding time in response to inquiry confirmation information aiming at the home inquiry message, wherein the home inquiry message is used for inquiring the home time of the home of the person who does not enter home, and the inquiry confirmation information carries the home time of the home of the person who does not enter home. The intelligent doorbell system and the intelligent doorbell system are beneficial to improving reliability of home safety protection of users.

Description

Data processing method and related device

Technical Field

The present disclosure relates to the field of data processing technologies, and in particular, to a data processing method and a related device.

Background

The intelligent doorbell is an intelligent household product. The existing intelligent doorbell is only used for detecting visiting personnel outside a door and sending visiting information to a resident so that the resident can check, and therefore living of the resident is met, and convenience is brought. However, the current intelligent doorbell can only reduce the possibility of potential safety hazards under the condition of personnel visiting by realizing the visiting detection function, and the range for preventing the condition of potential safety hazards in the life of residents is limited.

Disclosure of Invention

The embodiment of the application provides a data processing method and a related device, so as to improve the accuracy and the intelligence of data processing of a server, thereby improving the guarantee of night housing safety of a user.

In a first aspect, an embodiment of the present application provides a data processing method, which is applied to a server in a doorbell system, where the doorbell system includes the server, an intelligent doorbell, and a terminal device, and the method includes:

acquiring target image data at a target reminding time, wherein the target image data comprises image information in the intelligent doorbell monitoring area;

determining whether all households associated with the intelligent doorbell enter home according to the target image data;

If the analysis result is that the whole person enters home, a safety prompt prompting a user to execute anti-theft measures is sent to at least one of the intelligent doorbell or the terminal equipment;

and if the analysis result is that the person does not enter home, sending a home inquiry message to at least one of the intelligent doorbell or the terminal equipment, and updating the target reminding time in response to inquiry confirmation information aiming at the home inquiry message, wherein the home inquiry message is used for inquiring the home time of the home of the person who does not enter home, and the inquiry confirmation information carries the home time of the home of the person who does not enter home.

In one possible example of the first aspect, the determining, according to the target image data, an analysis result of whether all households associated with the smart doorbell are home, includes:

determining a target image segment from the target image data, wherein the target image segment is an image segment of a first resident when the first resident appears last before the target reminding time, and the first resident is any resident in all the residents;

determining an in-out state of the first resident according to the target image segment, wherein the in-out state is one of a home returning state and an out-out state;

And determining the home returning condition of the first resident according to the access state.

In yet another possible example of the first aspect, the determining a target image segment from the target image data includes:

matching the image information matched with the face information of the first resident in the target image data, and marking the image information as a first image fragment;

acquiring an indeterminate image fragment which carries human image information and does not carry human face information in the target image data;

screening a second image segment corresponding to a first resident from the indeterminate image segments according to the character information of the first resident, wherein the character information comprises at least one of the following: dressing information, make-up information, body shape information, and ceremony information;

and determining the image segment with the shortest time interval with the target reminding time in the first image segment and the second image segment as the target image segment.

In still another possible example of the first aspect, the character information includes dressing information, makeup information, body type information, and ceremony information, and the screening the second image segment corresponding to the first resident from the indeterminate image segments according to the character information of the first resident includes:

Obtaining a first similarity of the indeterminate image fragment and the dressing information, a second similarity of the indeterminate image fragment and the dressing information, a third similarity of the indeterminate image fragment and the dressing information, and a fourth similarity of the indeterminate image fragment and the dressing information according to the character information of the first resident;

determining the target similarity of the unfixed image slice according to the first similarity, the second similarity, the third similarity, the fourth similarity and preset weight parameters;

and if the target similarity is greater than a preset similarity, marking the indeterminate image fragment as the second image fragment.

In yet another possible example of the first aspect, the weight parameter includes:

the weight of the appearance information is larger than that of the body type information, the weight of the body type information is larger than that of the makeup information, and the weight of the makeup information is larger than that of the dressing information.

In yet another possible example of the first aspect, before the determining, according to the target image data, an analysis result of whether all households associated with the smart doorbell are home, the method further includes:

if it is determined that external personnel exist currently according to the target image data, a stay inquiry message is sent to at least one of the intelligent doorbell or the terminal equipment, wherein the external personnel refer to personnel outside a preset resident list;

Receiving a stay confirmation message from at least one of the smart doorbell or the terminal device;

if the stay confirmation information is stay, executing the analysis result of determining whether all households associated with the intelligent doorbell are home or not according to the target image data;

and if the stay confirmation information is not stay, executing the analysis result of determining whether all households associated with the intelligent doorbell are home or not according to the target image data after the foreign personnel are detected to leave.

In yet another possible example of the first aspect, the updating the target reminder time in response to the query confirmation information for the home inquiry message includes: if the home time is before a preset node, updating the target reminding time to the home time; and if the home time is after the preset node, sending the security prompt to at least one of the intelligent doorbell or the terminal equipment.

In a second aspect, an embodiment of the present application provides a data processing method, which is applied to an intelligent doorbell in a doorbell system, where the doorbell system includes a server, the intelligent doorbell, and a terminal device, and the method includes:

Acquiring image information in real time, and sending the image information to the server, wherein the image information is the image information in the monitoring range acquired by the intelligent doorbell;

receiving a safety prompt from the server, and broadcasting safety prompt content corresponding to the safety prompt in response to the safety prompt, wherein the safety prompt content is used for prompting a user to execute anti-theft measures, the safety prompt is the content sent by the server when the analysis result of whether all households associated with the intelligent doorbell come home is that all people come home according to target image data, and the target image data is a set of image information acquired by the intelligent doorbell in real time in a preset time period;

and receiving a home inquiry message from the server, wherein the home inquiry message is used for inquiring home time of a resident who does not home.

In a third aspect, an embodiment of the present application provides a data processing apparatus, which is applied to a server in a doorbell system, where the doorbell system includes the server, an intelligent doorbell, and a terminal device, and the apparatus includes:

the acquisition unit is used for acquiring target image data at the target reminding time, wherein the target image data comprises image information in the intelligent doorbell monitoring area;

The determining unit is used for determining whether all households associated with the intelligent doorbell enter home according to the target image data;

the reminding sending unit is used for sending a safety reminding for reminding a user to execute anti-theft measures to at least one of the intelligent doorbell or the terminal equipment when the analysis result is that the whole person enters home;

and the sending updating unit is used for sending a home-returning query message to at least one of the intelligent doorbell or the terminal equipment when the analysis result is that the person is not home-returning, and updating the target reminding time in response to query confirmation information aiming at the home-returning query message, wherein the home-returning query message is used for querying the home-returning time of the home not home-returning, and the query confirmation information carries the home-returning time of the home not home-returning.

In a fourth aspect, an embodiment of the present application provides a data processing apparatus, configured to be used in an intelligent doorbell in a doorbell system, where the doorbell system includes a server, the intelligent doorbell, and a terminal device, and the method includes:

the acquisition unit is used for acquiring image information in real time and sending the image information to the server, wherein the image information is the image information in the monitoring range acquired by the intelligent doorbell;

The receiving unit is used for receiving the safety prompt from the server, responding to the safety prompt, broadcasting safety prompt content corresponding to the safety prompt, and prompting a user to execute anti-theft measures, wherein the safety prompt is the content sent by the server when the analysis result of whether all households associated with the intelligent doorbell come home is that all the households come home according to target image data, and the target image data is a set of image information acquired by the intelligent doorbell in real time in a preset time period;

the receiving unit is further configured to receive a home inquiry message from the server, where the home inquiry message is used to inquire about a home time of a resident who is not home.

In a fifth aspect, embodiments of the present application provide an electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the first aspect of the embodiments of the present application.

In a sixth aspect, embodiments of the present application provide a computer storage medium storing a computer program for electronic data exchange, wherein the computer program causes a computer to perform some or all of the steps as described in the first aspect of the present embodiment.

It can be seen that, in this embodiment, the server obtains the target image data at the target reminding time, where the target image data includes the image information in the intelligent doorbell monitoring area; determining whether all households associated with the intelligent doorbell enter home according to the target image data; therefore, when the analysis result is that the whole person enters home, a safety prompt prompting the user to execute the antitheft measure can be sent to at least one of the intelligent doorbell or the terminal equipment; or when the analysis result is that the person does not enter home, sending a home-entering inquiry message to at least one of the intelligent doorbell or the terminal equipment, and updating the target reminding time in response to the inquiry confirmation information aiming at the home-entering inquiry message, wherein the home-entering inquiry message is used for inquiring the home-entering time of the home not entering home, and the inquiry confirmation information carries the home-entering time of the home not entering home. According to the method and the device, whether all households return home or not can be accurately identified by the server, different actions are executed according to different home return conditions, and accuracy and intelligence of image information processing by the server are improved. The server outputs a safety prompt through indicating the intelligent doorbell or the terminal equipment to remind the user to execute the antitheft measures, thereby being beneficial to improving the guarantee of night residence safety of the resident, reducing the possibility of generating potential safety hazards and improving the diversity of doorbell system functions.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1a is a schematic architecture diagram of a doorbell system according to an embodiment of the present application;

FIG. 1b is a diagram illustrating an example of the composition of an electronic device according to an embodiment of the present application;

FIG. 2 is a schematic flow chart of a data processing method according to an embodiment of the present application;

fig. 3a is an interface display diagram of a terminal device or a smart doorbell according to an embodiment of the present application;

fig. 3b is an interface display diagram of another terminal device or smart doorbell provided in an embodiment of the present application;

fig. 3c is a schematic view of an interface display of a terminal device or a smart doorbell according to an embodiment of the present application;

FIG. 4 is a flowchart of another data processing method according to an embodiment of the present disclosure;

FIG. 5a is a block diagram of functional units of a data processing apparatus according to an embodiment of the present application;

FIG. 5b is a block diagram illustrating functional units of another data processing apparatus according to an embodiment of the present application;

FIG. 6a is a block diagram of functional units of yet another data processing apparatus according to an embodiment of the present application;

fig. 6b is a block diagram showing functional units of a further data processing apparatus according to an embodiment of the present application.

Detailed Description

In order to make the present application solution better understood by those skilled in the art, the following description will clearly and completely describe the technical solution in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art based on the embodiments herein without making any inventive effort, are intended to be within the scope of the present application.

The terms first, second and the like in the description and in the claims of the present application and in the above-described figures, are used for distinguishing between different objects and not for describing a particular sequential order. Furthermore, the terms "comprise" and "have," as well as any variations thereof, are intended to cover a non-exclusive inclusion. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those listed steps or elements but may include other steps or elements not listed or inherent to such process, method, article, or apparatus.

Reference herein to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments.

In daily life, night is a high-incidence period of a theft event, and in order to prevent theft, households often take certain anti-theft measures, for example, inserting a key into a security door lock from a house, using a door stopper in the house, and the like. However, these effective anti-theft measures are required to be manually carried out by the households, and are easy to forget by the households to generate potential safety hazards.

In order to solve the above problems, the present application provides a data processing method and related apparatus. The server can accurately identify the home returning condition of the resident, and instruct the intelligent doorbell or the terminal equipment to output a safety prompt to remind the user to execute the antitheft measures, so that the possibility of potential safety hazards caused by forgetting of the user is reduced, the accuracy and the intelligence of the server for data processing are improved, and the diversity of doorbell system functions is improved.

Embodiments of the present application are described below with reference to the accompanying drawings.

The technical solution of the present application may be applied to a doorbell system 10 as shown in fig. 1a, where the doorbell system 10 comprises a server 100, a smart doorbell 200, and a terminal device 300. Wherein the terminal device comprises at least one. The terminal equipment can provide application services for users, and the application services can realize the functions of the terminal equipment such as display, user operation, information receiving, information sending and the like. Wherein, intelligent doorbell is equipped with at least one camera.

The terminal device described in the embodiments of the present application may include a smart Phone (such as an Android mobile Phone, an iOS mobile Phone, a Windows Phone mobile Phone, etc.), a tablet computer, a palm computer, a notebook computer, a smart home central control or wearable device (such as a smart watch, a bluetooth headset, etc.), etc.

The server described in the embodiments of the present application may be a physical device, such as a server or a host, or may be a virtual device, such as a virtual machine or a container. Alternatively, the server may be a cloud, such as a server cluster formed by a single service or multiple servers in the cloud, or may be a local device, such as a server cluster formed by a local single service or multiple servers.

Alternatively, the terminal device and the server may be directly connected through wired communication, such as a tangible medium such as a metal wire or an optical fiber, or may be indirectly connected through wireless communication, such as an intangible medium such as a wireless lan or bluetooth. In particular, the terminal device may receive the message from the server, e.g., the terminal device may receive the content from the server, such as a security alert, a home inquiry message, a stay inquiry message, etc., and play and/or display the received content from the server. The terminal device may also transmit content corresponding to the user operation to the server according to the user operation, for example, the terminal device may transmit content such as home confirmation information, stay confirmation information, and the like to the server.

Alternatively, the server and the intelligent doorbell may be directly connected through wired communication, such as a tangible medium such as a metal wire or an optical fiber, or indirectly connected through wireless communication, such as an intangible medium such as a wireless lan or bluetooth. In particular, the smart doorbell may receive messages from the server, e.g., the smart doorbell may receive security reminders, home inquiry messages, stay inquiries, etc. from the server and play and/or display the received content from the server. And, the intelligent doorbell can also send the content corresponding to the user operation to the server according to the user operation, for example, the intelligent doorbell can send the content such as the confirmation information of returning home, the confirmation information of staying in the home to the server.

In an alternative embodiment, the smart doorbell may comprise an indoor unit and an outdoor unit. The outdoor unit may perform information interaction with the indoor unit through wired communication or wireless communication. The outdoor unit can be fixed outside the door by means of adhesion, screw connection and the like. The outdoor unit may be a device independent of the door lock for collecting image information outside the door. The indoor unit may be fixed to the inner surface of the door or placed in an indoor environment. The indoor unit can be used for viewing image information collected by the outdoor unit, playing prompts such as visiting bell, or collecting indoor image information. At least one of the indoor unit and the outdoor unit can be connected with the server in a wireless communication mode so as to send the acquired outdoor image information and indoor image information to the server.

It should be noted that, in view of the fact that devices with remote information interaction capability require more computing power, it is also necessary to be supported by a more stable and sustained power supply. Because the indoor unit arranged indoors is easier to acquire stable and continuous power supply support than the outdoor unit arranged outdoors, the indoor unit can directly establish remote communication connection with the server, and the outdoor unit establishes connection with the server through the indoor unit, so that the indoor unit can transfer information between the outdoor unit and the server. That is, in practical application, the outdoor unit may send the collected image information to the indoor unit, so as to upload the image information to the server through the indoor unit.

The electronic device in the present application may be a server 100, a smart doorbell 200, or a terminal device 300, as shown in fig. 1b, and the electronic device may include a processor 110, a memory 120, a communication interface 130, and one or more programs 121, where the one or more programs 121 are stored in the memory 120 and configured to be executed by the processor 110, and the one or more programs 121 include instructions for executing any step in the method embodiments.

Wherein the communication interface 130 is used to support communication between the electronic device and other devices. The processor 110 may be, for example, a central processing unit (Central Processing Unit, CPU), a general purpose processor, a digital signal processor (Digital Signal Processor, DSP), an Application-specific integrated circuit (Application-Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic device, transistor logic device, hardware components, or any combination thereof. Which may implement or perform the various exemplary logic blocks, units and circuits described in connection with the disclosure of embodiments of the present application. The processor may also be a combination that performs the function of a computation, e.g., a combination comprising one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

The memory 120 may be volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically Erasable EPROM (EEPROM), or a flash memory. The volatile memory may be random access memory (random access memory, RAM) which acts as an external cache. By way of example but not limitation, many forms of random access memory (random access memory, RAM) are available, such as Static RAM (SRAM), dynamic Random Access Memory (DRAM), synchronous Dynamic Random Access Memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced Synchronous Dynamic Random Access Memory (ESDRAM), synchronous Link DRAM (SLDRAM), and direct memory bus RAM (DR RAM).

In a specific implementation, the processor 110 is configured to perform any step performed by a server, a smart doorbell, or a terminal device in the method embodiment described below, and optionally invoke the communication interface 130 to complete a corresponding operation when performing data transmission such as sending.

It should be noted that the above schematic structural diagram of the electronic device is merely an example, and more or fewer devices may be specifically included, which is not limited only herein.

Referring to fig. 2, fig. 2 is a flowchart of a data processing method according to an embodiment of the present application, where the method may be applied to a server in a doorbell system as shown in fig. 1a or fig. 1b, and as shown in fig. 2, the data processing method includes:

s210, acquiring target image data at the target reminding time.

The target image data comprise image information in the intelligent doorbell monitoring area. Specifically, the target image data may include all image information collected by the smart doorbell, or the target image data may include all image information within a target preset period. The target preset time period can be any time measured by taking days, weeks and the like as units so as to ensure the integrity of data. For example, when the target preset period is one day, the target image data includes image information collected by the intelligent doorbell between the target reminding time corresponding to the current date and the target reminding time corresponding to the previous day date.

The target reminding time can be any time in one day. For example, the target reminder time may be nine evening, ten evening, two morning hours, etc. The target reminding time can be set according to the actual demands of users.

In a specific implementation, if all the image information collected by the intelligent doorbell includes image content of multiple days, the server can analyze and determine the home time of all the households in the households every day according to all the image information collected by the intelligent doorbell, and then determine the latest home time in the home time corresponding to the latest home in all the image information respectively corresponding to each date as the recommended time, so that the target reminding time is set as the recommended time. Wherein, all image information that intelligent doorbell gathered includes, but is not limited to target image data. For example, the server may analyze and determine, according to all the image information collected by the intelligent doorbell, home returning times corresponding to the latest home returning households corresponding to different dates, which are 21:04, 22:52, 21:38, 22:16, 20:10, and 20:33 respectively. The server may then determine the latest home time 22:52 from these home times and determine that time as the recommended time. Alternatively, the whole time (e.g., 23:00) adjacent to the home time is determined as the recommended time.

Or in specific implementation, the server can also determine the home-returning time with highest occurrence frequency in the home-returning time corresponding to the latest home-returning household in all the image information acquired by the intelligent doorbell as the recommended time, so that the target reminding time is set as the recommended time, and the accuracy of setting the target reminding time is improved. For example, the server may analyze and determine, according to all the image information collected by the intelligent doorbell, home returning times corresponding to the latest home returning households corresponding to different dates, which are 21:04, 22:52, 22:28, 22:16, 22:10, and 20:33 respectively. The server may then determine that the time range intervals to which the home time belongs include: eight and a half evening to nine evening, nine and a half evening, ten and a half evening to ten and a half evening. The server may further determine that the home time occurs most frequently between ten pm and ten and a half pm in the time range interval. Therefore, the server can determine the end time ten-point half of the time range section as the recommended time. The time range interval may be any duration measured in units of minutes, hours, and the like, and is not limited herein.

Or in a specific implementation, the target reminding time can be directly and manually selected and set by a resident through an intelligent doorbell or a terminal device. Alternatively, the target reminder time may be modified by the resident based on the server recommended time.

S220, determining whether all households associated with the intelligent doorbell enter the home according to the target image data.

Wherein the households are people in a preset household list. The preset resident list can be input through the intelligent doorbell or the terminal equipment when the intelligent doorbell is started for the first time, and the content of the preset resident list can be updated and corrected in the subsequent use process. The preset resident list comprises the name, image information and other contents of each resident.

In a specific implementation, when the server detects that the target reminding time is reached, the server can analyze all image information collected by the intelligent doorbell. Or, the image information in the target preset time period can be extracted from all the image information collected by the intelligent doorbell, and then the image information is analyzed, so that an analysis result representing whether all households associated with the intelligent doorbell return home or not is obtained.

And S230, if the analysis result is that the whole person enters home, a safety prompt prompting the user to execute the antitheft measure is sent to at least one of the intelligent doorbell or the terminal equipment.

Among these theft measures include, but are not limited to, inserting a key from the house into a theft gate lock, using a door blocker in the house, etc.

Specifically, if the server determines that the analysis result is that the whole person enters home, the server indicates that all households are in home when the target reminding time is reached, and the server can send a safety reminder to the intelligent doorbell, the terminal equipment or the intelligent doorbell and the terminal equipment.

In the specific implementation, when the receiving object of the server sending the safety reminding comprises an intelligent doorbell, the intelligent doorbell can receive the safety reminding through the indoor unit and broadcast the content of the safety reminding through the indoor unit. For example, the broadcast content may be "please perform anti-theft measures", "please lock the door", "please enable the door stopper", etc. Or, the indoor unit can play a ringing sound corresponding to the safety prompt according to the received safety prompt so as to remind the user to execute the antitheft measure. The receiving object for the safety reminding can ensure that the resident knows the timeliness and reliability of the safety reminding by setting the intelligent doorbell.

Or in a specific implementation, when the receiving object for sending the safety prompt by the server comprises the terminal equipment, the terminal equipment can pop up prompt information or broadcast message prompt sound in a popup window mode in a display interface of the terminal equipment through an application service function after receiving the safety prompt. For example, referring to fig. 3a, fig. 3a is an interface display diagram of a terminal device or a smart doorbell according to an embodiment of the present application. In the interface 410 that the terminal device can display in the visible area of the screen after receiving the security prompt, the prompt message in the popup window 411 is displayed in a popup window mode, wherein the prompt message may be "night deep, please remember to lock the anti-theft door", so as to realize that the intelligent doorbell or the terminal device responds to the received security prompt to prompt the user to execute the stop operation.

In one possible embodiment, when the door lock in the home is an intelligent door lock, the server may also be in communication with the intelligent door lock and send a door locking message to the intelligent door lock to instruct the intelligent door lock to automatically lock the door.

And S240, if the analysis result is that the person does not enter home, sending a home-entering inquiry message to at least one of the intelligent doorbell or the terminal equipment, and updating the target reminding time in response to inquiry confirmation information aiming at the home-entering inquiry message.

The home inquiry message is used for inquiring home time of the home not returned. The inquiry confirmation information carries the home time of the home not home. Wherein, the households who do not go home may have one or more, and no further limitation is made herein.

Specifically, if the server determines that the analysis result is that the whole person is not home, the server indicates that the resident is still not home when the target reminding time is reached. The server may send a home inquiry message to the smart doorbell, the terminal device, or both to inquire about the home time of the home not home. The intelligent doorbell, the terminal device, or the intelligent doorbell and the terminal device can send an inquiry confirmation message carrying the home time to the server after receiving the home inquiry message. And the server receives the inquiry confirmation information from the intelligent doorbell or the terminal equipment and confirms whether the home is returned to the home on the current day of the home of the non-home resident according to the inquiry confirmation information.

In a specific implementation, if the receiving object of the home inquiry message is a terminal device, the terminal device may be a terminal device used by a resident that does not enter home, or the terminal device may be a terminal device used by another resident associated with the intelligent doorbell, which is not limited herein. When receiving the home inquiry message, the terminal device can pop up the home inquiry message in a popup window and other modes in a display interface of the terminal device through a reminding function of the application service, and a resident can jump to the application service corresponding to the intelligent doorbell after clicking the popup window so as to set the home time in the application service, thereby enabling the terminal device to send inquiry confirmation information carrying the home time of the resident which does not home to the server. For example, after entering the application service, the visual area of the terminal device may first display an application display interface 420 as shown in fig. 3b, and the resident may click a time setting icon 422 to select to set the home time of the resident that is not home, and then the terminal device responds to the triggering operation of the resident on the first confirmation icon 421 to generate the inquiry confirmation information carrying the home time, and send the inquiry confirmation information to the server.

In a specific implementation, if the receiving object of the home-returning query message includes an intelligent doorbell, the intelligent doorbell may query the home-returning time of the home-non-home-returning resident through broadcasting after receiving the home-returning query message. A resident in the home can reply in a voice input manner through the intelligent doorbell, so that inquiry confirmation information carrying the reply corresponding home returning time is sent to the server through the intelligent doorbell. Or in a specific implementation, if the indoor unit of the intelligent doorbell is provided with an operation screen, when the receiving object of the home-returning query message is the intelligent doorbell, the intelligent doorbell can also see the implementation mode on the terminal device, and corresponding content is displayed in a visible area of the operation screen so as to be operated by a resident at home, so that the intelligent doorbell generates and sends the query confirmation message carrying the home-returning time to the server. The display content and the operation manner of the operation screen can be referred to the above terminal device, and will not be described in detail herein.

In one possible example, the updating the target reminder time in response to the query confirmation information for the home inquiry message includes: if the home time is before a preset node, updating the target reminding time to the home time; and if the home time is after the preset node, sending the security prompt to at least one of the intelligent doorbell or the terminal equipment.

The end node of the current time range of the node is preset. The time of the start node and the end node of the time of day range may be set arbitrarily, and is not limited herein. For example, the time of day may range from seven in the morning of 2023, 02, and 03, to seven in the morning of 2023, 02, and 03, wherein seven in the morning of 2023, 02, and 03, are the start node and seven in the morning of 2023, 02, and 03, are the end node.

In a specific implementation, after receiving the inquiry confirmation message, the server can compare the home time carried by the inquiry confirmation message with the time corresponding to the end node. If the home time is earlier than the time corresponding to the end node, namely the home time is within the time range of the same day, the home of the home not home is indicated to be home on the same day. Otherwise, the method is reverse. Specifically, if the server compares and confirms that the home time is earlier than the time corresponding to the end node, the target reminding time can be updated, so that after the home of the home is returned, a safety reminder is sent to at least one of the intelligent doorbell or the terminal device, and the home of the home which is not returned is prevented from being locked outside the door. Specifically, the updated target reminding time may be a home time, or the updated target reminding time is a time when the server detects that the home of the home not home is returned according to the image information acquired in real time, so as to improve accuracy and timeliness of sending the safety reminding. If the server compares and confirms that the home keeping time is later than the time corresponding to the end node, the server characterizes that all other living rooms are home keeping, and at the moment, the server can directly send a safety prompt to at least one of the intelligent doorbell or the terminal equipment so as to remind the living rooms at home of timely executing anti-theft measures.

In one possible example, the determining, according to the target image data, an analysis result of whether all households associated with the smart doorbell are home, includes: determining a target image segment from the target image data, wherein the target image segment is an image segment when the first resident appears last before the target reminding time, and the first resident is any resident in all the residents; determining an in-out state of the first resident according to the target image segment, wherein the in-out state is one of a home returning state and an out-out state; and determining the home returning condition of the first resident according to the access state.

The image segments of the first resident appearing last before the target reminding time refer to image segments with the shortest time interval from the target reminding time in all the image segments of the first resident appearing in the target image data.

Specifically, when determining whether all households associated with the intelligent doorbell enter the home according to the target image data, the server can respectively take all households in a household list associated with the intelligent doorbell as first households so as to determine target image fragments respectively corresponding to different households from the target image data; determining the corresponding resident access state according to each target image segment; according to the method, the home returning conditions of different households are correspondingly determined according to the access states corresponding to the different households, and therefore whether all households associated with the intelligent doorbell return to home or not is determined.

In a specific implementation, the server may compare the image information of the first resident with the target image data, thereby extracting all the image segments of the first resident from the target image data, and then ordering the image segments according to the time sequence, so as to mark the image segment with the shortest time interval between the occurrence time of the image segment and the target reminding time as the target image segment. Then, the server analyzes and confirms the action track of the first resident according to the target image segment, so that the access state of the first resident is determined according to the action track of the first resident. Specifically, if the first resident appears in the target image segment and then gradually approaches the intelligent doorbell after appearing in the monitoring area of the intelligent doorbell, the action track of the first resident is indicated to be a home-returning track, and at this time, the in-out state of the first resident can be determined to be a home-returning state. If the first resident is gradually far away from the intelligent doorbell after appearing in the target image segment in the monitoring area of the intelligent doorbell, the action track of the first resident is indicated to be an outgoing track, and at the moment, the in-out state of the first resident can be determined to be an outgoing state. After determining the access state of each first resident, the server can determine the home returning situation corresponding to all the residents according to the corresponding access state, so as to determine the analysis result of whether all the residents return home according to the home returning situation corresponding to all the residents. Specifically, if the in-out state corresponding to a certain first resident is the out state, the home returning condition of the resident is indicated to be not home returning, and the analysis result is that the resident is not home returning by the whole person. If the access states of all the first households are home-returning states, the home-returning conditions of all the households are indicated to be home-returning, and the analysis result is that the whole person is home-returning.

In this example, the server extracts the target image segment from the target image data, and then determines the in-out state of the first resident according to the target image segment, so that the home returning condition of the first resident is determined according to the in-out state of the resident, the server can be ensured to accurately identify and determine the analysis result of whether all the residents return to home, and the accuracy of information prompt of the server is improved.

In one possible example, the determining the target image segment from the target image data includes: matching the image information matched with the face information of the first resident in the target image data, and marking the image information as a first image fragment; acquiring an indeterminate image fragment which carries human image information and does not carry human face information in the target image data; screening a second image segment corresponding to a first resident from the indeterminate image segments according to the character information of the first resident, wherein the character information comprises at least one of the following: dressing information, make-up information, body shape information, and ceremony information; and determining the image segment with the shortest time interval with the target reminding time in the first image segment and the second image segment as the target image segment.

The portrait information refers to information content including at least one of face information and character information. The person information is carried when the person information is carried and the person information is not carried, and the person information can be person information of any object.

Wherein, there is at least one first image section. The second image segment has at least one. The target image segments are the image segments with the shortest time interval with the target reminding time in all the first image segments and all the second image segments.

In a specific implementation, the server may directly match image information corresponding to the face information of the first resident from the target image data, and mark the image information as the first image segment. Or, the server may extract a face image segment including face information from the target image data, and then match a face image segment corresponding to the face information of the first resident from the plurality of face image segments, and mark the face image segment as the first image segment. Therefore, when the server determines the home returning condition of different households, the face information of the different households is only required to be compared with the plurality of face image fragments, and the face information of the different households is not required to be matched with the whole target image data, so that the processing pressure of the server can be reduced.

In a specific implementation, when determining the second image segment, the server may extract a non-face image segment that does not include face information from the target image data, and then screen and determine a person image segment that carries person image information from the non-face image segment, thereby determining the person image segment as an indeterminate image segment, and further screen the second image segment from the indeterminate image segment according to the person information of the first resident. Or, the server may extract the person image segments carrying the person image information from the target image data, then screen the person image segments not including the face from the person image segments, determine the person image segments as the indeterminate image segments, and further screen the second image segments from the indeterminate image segments according to the person information of the first resident. Specifically, in order to reduce the processing amount of the server and simplify the processing procedure of the server, the server may determine the amorphous image segments in the former manner to divide the target image data into the face image segments and the non-face image data in the process of determining the first image segments.

In this example, the server screens the first image segment from the target image data through the face information of the first resident, screens the second image segment from the target image data through the character information of the first resident, and determines the image segment with the shortest time interval with the target reminding time in the first image segment and the second image segment as the target image segment, which is beneficial to improving the accuracy and the comprehensiveness of the server in data processing, thereby improving the accuracy of the server in identifying the home returning condition of the first resident, and further ensuring the reliability of the safety reminding function provided by the doorbell system.

In one possible example, the character information includes dressing information, makeup information, body type information, and ceremony information, and the screening the second image segment corresponding to the first resident from the indeterminate image segments according to the character information of the first resident includes: obtaining a first similarity of the indeterminate image fragment and the dressing information, a second similarity of the indeterminate image fragment and the dressing information, a third similarity of the indeterminate image fragment and the dressing information, and a fourth similarity of the indeterminate image fragment and the dressing information according to the character information of the first resident; determining the target similarity of the unfixed image slice according to the first similarity, the second similarity, the third similarity, the fourth similarity and preset weight parameters; and if the target similarity is greater than a preset similarity, marking the indeterminate image fragment as the second image fragment.

The preset similarity is used for representing the minimum similarity standard of the portrait information in the undetermined image fragment and the personage information of the first resident.

The preset weight parameters comprise a first weight corresponding to the first similarity, a second weight corresponding to the second similarity, a third weight corresponding to the third similarity and a fourth weight corresponding to the fourth similarity. The first weight is used for representing the importance degree of dressing information, the second weight is used for representing the importance degree of makeup information, the third weight is used for representing the importance degree of body type information, and the fourth weight is used for representing the importance degree of weight of appearance information.

Specifically, the numerical relation of each weight in the preset weight parameters can be set arbitrarily according to the requirements. Alternatively, in one possible example, the weight parameters include: the weight of the appearance information is larger than that of the body type information, the weight of the body type information is larger than that of the makeup information, and the weight of the makeup information is larger than that of the dressing information. That is, the first weight > the third weight > the second weight > the first weight. The importance of different features can be embodied through weight differentiation settings respectively corresponding to dressing information, makeup information, body type information and appearance information, and the setting can improve the accuracy of association of an indeterminate image segment represented by target similarity and a first resident, thereby ensuring the reliability of the recognition result of the home-returning condition of the first resident.

In particular implementations, the server may first select from dressing features, make-up features, body shape features, and appearance features in a single amorphous video segment. The dressing features, the makeup features and the body type features can be extracted and determined from the uncertain image fragments through methods such as edge detection, corner detection and the like. The instrument state characteristics can be extracted and determined from the uncertain image fragments through methods such as joint point detection, behavior analysis and the like. The server obtains a first similarity by comparing the dressing characteristic with dressing information of the first resident, obtains a second similarity by comparing the dressing characteristic with dressing information of the first resident, obtains a third similarity by comparing the body type characteristic with reminding information of the first resident, obtains a fourth similarity by comparing the body type characteristic with the body type information of the first resident, and then calculates a first product of the first similarity and the first weight, a second product of the second similarity and the second weight, a third product of the third similarity and the third weight, and a fourth product of the first similarity and the first weight. And the server sums the first product, the second product, the third product and the fourth product to obtain the target similarity. The server may retrieve a preset similarity, compare the target similarity with the preset similarity, and if the target similarity is greater than the preset similarity, indicate that the similarity between the undetermined image segment and the portrait information of the first resident is sufficiently large, and at this time, determine the undetermined image segment as a second image segment associated with the first resident. If the target similarity is smaller than or equal to the preset similarity, the fact that the correlation between the undetermined image segment and the first resident is insufficient is indicated, and the undetermined image segment at the moment is interference information.

For example, if the preset similarity is 85%, the preset weight parameter is a first weight of 0.6, a third weight of 0.25, a second weight of 0.1, and a first weight of 0.05. If the server compares the character information of a certain undetermined image segment with the character information of the first resident to obtain a first similarity of 50%, a second similarity of 95%, a third similarity of 98%, and a fourth similarity of 97%, the target similarity is: 50%. 0.05+95%. 0.1+98%. 0.25+97%. 0.6=94.7% > 85%, indicating that the amorphous segment may be marked as a second segment.

It can be seen that, in this example, the server is beneficial to ensuring the comprehensiveness of the evaluation of the indeterminate image segments by determining the similarity between the indeterminate image segments and the dressing information, the makeup information, the body type information and the appearance information in the character information of the first resident respectively, and calculating the weight sum of each similarity according to the preset weight parameters, thereby ensuring the reliability of the association between the second image segments and the first resident.

In one possible example, before the determining, according to the target image data, an analysis result of whether all households associated with the smart doorbell are home, the method further includes: if it is determined that external personnel exist currently according to the target image data, a stay inquiry message is sent to at least one of the intelligent doorbell or the terminal equipment, wherein the external personnel refer to personnel outside a preset resident list; receiving a stay confirmation message from at least one of the smart doorbell or the terminal device; if the stay confirmation information is stay, executing the analysis result of determining whether all households associated with the intelligent doorbell are home or not according to the target image data; and if the stay confirmation information is not stay, executing the analysis result of determining whether all households associated with the intelligent doorbell are home or not according to the target image data after the foreign personnel are detected to leave.

The stay inquiry message is used for indicating the intelligent doorbell or the terminal equipment to broadcast or display the stay inquiry message. The stay inquiry information is used to inquire whether the resident alien person stays on the same day.

In a specific implementation, when the server detects that the target reminding time is reached, whether a foreign person exists in the home at the moment can be determined according to the target image data. If there are foreign people at home, a stay inquiry message may be sent to at least one of the smart doorbell or the terminal device to inquire whether the resident foreign people want to stay. At least one of the smart doorbell or the terminal device may send a stay confirmation message to the server based on the stay inquiry message to inform the server of the result of whether the foreign person is stay. If the stay confirmation message characterizes that the foreign person is to stay, the foreign person is indicated not to leave on the same day. At the moment, the server can determine the analysis result of whether all households associated with the intelligent doorbell return home according to the target image data. If the stay confirmation message indicates that the foreign person is not staying, the server can send a safety reminder to at least one of the intelligent doorbell or the terminal device after detecting that the foreign person leaves according to the image information acquired in real time, so as to prompt the user to execute the antitheft measure. If no external person exists in the home, the server can directly determine the analysis result of whether all households associated with the intelligent doorbell return to home according to the target image data.

Specifically, when the server determines that the external person appears according to the target image data, all image segments of the external person appearing in the target image data can be extracted, then according to the time sequence of the external person appearing in the image information, the image segment with the shortest time interval between the appearance time of the external person and the target reminding time is determined from all image segments, and the in-out state of the external person is determined according to the image segment, so that whether the external person exists in the home currently is determined according to the in-out state.

In one possible example, when the extraneous person is left standing, the method further comprises: sending a stay time length inquiry message to at least one of the intelligent doorbell and the terminal device; receiving stay time length reply information from the intelligent doorbell or the terminal equipment, wherein the stay time length reply information comprises stay time of the external personnel; and updating a resident list according to the stay time reply information so as to add the extraneous personnel as personnel in the resident list during stay of the extraneous personnel.

The server may send the stay time length inquiry message to the smart doorbell or the terminal device that sends the stay reply message. Alternatively, the server may send a stay length inquiry message to a smart doorbell or terminal device that does not send the stay reply message, without further limitation.

In a specific implementation, when the server determines that the foreign person is to stay according to the stay reply information, the server may further send a stay time length inquiry message to at least one of the smart doorbell and the terminal device to inquire the stay time of the foreign person. The intelligent doorbell or the terminal device can send the stay time reply information to the server based on the user operation after receiving the stay time inquiry message, so that the server is informed of the stay time of external personnel. If the server determines that the external person stays on the same day only according to the stay time, namely the stay time is one day, whether the resident is home-returned by the whole person is determined directly according to the target image data. If the server determines that the stay time of the extraneous person is longer than one day according to the stay time, it may add the extraneous person as a temporary resident to the resident list during stay of the extraneous person, and delete the extraneous person from the resident list when stay expires.

Specifically, when the server adds the external person as the temporary resident in the resident list, the server can directly extract the image of the external person from the target image data without re-uploading the resident. Thereby improving the convenience of the use of households and the intelligence of the data processing of the server.

For example, referring to fig. 3c, fig. 3c is a schematic view of an interface display of another terminal device or smart doorbell according to an embodiment of the present application. The stay length query message may be displayed within a viewable area of the smart doorbell or the terminal device via an interface display such as display interface 430. The target resident may fill in the stay time in the duration entry by clicking on the duration entry icon 431, with manual entry. Alternatively, the stay time for setting the extraneous person can be adjusted by clicking on the increase icon 432 or the decrease icon 433. After the stay time setting is completed, the target resident may click on the second confirm icon 434 to cause the smart doorbell or the terminal device to send a stay time reply message carrying the stay time to the server.

In particular, when the stay time of the external person is longer than one day, the server takes the external person as a temporary resident during stay of the external person, and detects whether the external person enters home every day. If the server detects that the foreign person does not enter home at the target reminding time of any day in the foreign person stay period, the server can send a leaving inquiry message to at least one of the intelligent doorbell and the terminal device so as to confirm whether the foreign person is to continue to stay to the resident. The smart doorbell or terminal device may send a leave reply message to the server to inform the server whether the alien person continues to stay. If the external personnel still remain to stay, the server can send a safety prompt to the intelligent doorbell or the terminal device after the external personnel and all other households come home. If the foreign personnel do not stay on, the server can delete the foreign personnel from the resident list directly before the stay time is over, so that the foreign personnel do not serve as temporary resident any more, and the home-returning condition of the foreign personnel is detected every day, and therefore the flexibility and the accuracy of detecting whether the resident is home-returning or not by the server are improved.

It can be seen that in this example, the server can improve the accuracy of the server in identifying whether to prompt information by determining whether there are extraneous persons in the home at the target prompt time and determining whether the extraneous persons remain when there are extraneous persons in the home, so that the user experience of the user using the safety prompt function can be improved. Further, in the case that the foreign person is left, the server may inquire about the stay time of the foreign person by transmitting a stay time inquiry message to at least one of the smart doorbell and the terminal device, and then after determining the stay time of the foreign person according to the stay time reply message from the smart doorbell or the terminal device, update the resident list according to the stay time, thereby adding the foreign person as a temporary resident in the resident list during the stay of the foreign person, and deleting the foreign person from the resident list at the expiration of the stay. Therefore, the server can detect whether the server enters home or not every day by taking the external person as a temporary resident during the stay period, so that the accuracy of the server in identifying the analysis result of whether the resident enters home or not can be further improved, and the accuracy and the intelligence of the server in information prompt are further improved.

Referring to fig. 4, fig. 4 is a schematic diagram of another data processing method according to an embodiment of the present application, where the method may be applied to a smart doorbell in a doorbell system as shown in fig. 1a or 1b, and the data processing method includes:

step S510, obtaining image information in real time, and sending the image information to the server.

The image information is the image information in the monitoring range collected by the intelligent doorbell.

In the specific implementation, the intelligent doorbell can acquire the image information of the monitoring range in real time in the use process, and the image information is sent to the server. The server can receive and store all the image information so as to acquire target image data according to all the stored image information when the target reminding time is detected.

And step S520, receiving the safety prompt from the server, and responding to the safety prompt to broadcast the safety prompt content corresponding to the safety prompt.

The safety prompt content is used for prompting a user to execute anti-theft measures, the safety prompt is used for determining whether analysis results of whether all households associated with the intelligent doorbell come home or not are sent when the intelligent doorbell comes home according to target image data, and the target image data is a set of image information acquired by the intelligent doorbell in real time within a preset time period

The intelligent doorbell can broadcast prompt contents or rings corresponding to the safety prompt when receiving the safety prompt. Thereby reminding the user to perform the anti-theft measure.

It can be seen that the intelligent doorbell collects the image information in real time and sends the image information to the server, so that the reliability and the integrity of target image data acquired by the server can be ensured, and the accuracy of identifying home returning conditions of residents by the server can be improved. In addition, when setting up intelligent doorbell as the receipt object of safety warning, can also guarantee that the resident knows timeliness and the reliability of safety warning, improve the security at resident's house.

In one possible example, the smart doorbell may also receive a home inquiry message from the server and send an inquiry confirmation message to the server. When the non-home resident exists, the server timely knows and feeds back the condition of the non-home resident, so that the server timely responds and executes corresponding operation.

The present application may divide functional units of a server according to the above method example, for example, each functional unit may be divided corresponding to each function, or two or more functions may be integrated in one processing unit. The integrated units may be implemented in hardware or in software functional units. It should be noted that, in the embodiment of the present application, the division of the units is schematic, which is merely a logic function division, and other division manners may be implemented in actual practice.

Fig. 5a is a functional unit block diagram of a data processing apparatus according to an embodiment of the present application. The data processing device 60 may be applied to a server in a doorbell system as shown in fig. 1a or 1b, the data processing device 60 comprising:

an obtaining unit 610, configured to obtain target image data at a target reminding time, where the target image data includes image information in the intelligent doorbell monitoring area;

a determining unit 620, configured to determine, according to the target image data, an analysis result of whether all households associated with the smart doorbell are home or not;

a reminder sending unit 630, configured to send a security reminder to at least one of the smart doorbell or the terminal device, the security reminder prompting a user to perform the antitheft measure when the analysis result is that the whole person enters home;

and a sending updating unit 640, configured to send a home-returning query message to at least one of the smart doorbell or the terminal device when the analysis result is that the person is not home, and update the target reminding time in response to query confirmation information for the home-returning query message, where the home-returning query message is used for querying home-returning time of a home not home, and the query confirmation information carries home-returning time of the home not home.

In one possible example, in terms of the analysis result of determining whether all households associated with the smart doorbell are home based on the target image data, the determining unit is specifically configured to: determining a target image segment from the target image data, wherein the target image segment is an image segment when the first resident appears last before the target reminding time, and the first resident is any resident in all the residents; determining an in-out state of the first resident according to the target image segment, wherein the in-out state is one of a home returning state and an out-out state; and determining the home returning condition of the first resident according to the access state.

In one possible example, in said determining a target image segment from said target image data, said determining unit is specifically further configured to: matching the image information matched with the face information of the first resident in the target image data, and marking the image information as a first image fragment; acquiring an indeterminate image fragment which carries human image information and does not carry human face information in the target image data; screening a second image segment corresponding to a first resident from the indeterminate image segments according to the character information of the first resident, wherein the character information comprises at least one of the following: dressing information, make-up information, body shape information, and ceremony information; and determining the image segment with the shortest time interval with the target reminding time in the first image segment and the second image segment as the target image segment.

In one possible example, the character information includes dressing information, makeup information, body type information, and appearance information, and the determining unit is specifically further configured to, in terms of screening the second image segment corresponding to the first resident from the indeterminate image segments according to the character information of the first resident: obtaining a first similarity of the indeterminate image fragment and the dressing information, a second similarity of the indeterminate image fragment and the dressing information, a third similarity of the indeterminate image fragment and the dressing information, and a fourth similarity of the indeterminate image fragment and the dressing information according to the character information of the first resident; determining the target similarity of the unfixed image slice according to the first similarity, the second similarity, the third similarity, the fourth similarity and preset weight parameters; and if the target similarity is greater than a preset similarity, marking the indeterminate image fragment as the second image fragment.

In one possible example, the weight parameters include: the weight of the appearance information is larger than that of the body type information, the weight of the body type information is larger than that of the makeup information, and the weight of the makeup information is larger than that of the dressing information.

In one possible example, the data processing apparatus further comprises a stay confirmation unit, specifically configured to: before determining whether all households associated with the intelligent doorbell enter the home according to the target image data, if determining that external personnel currently exist according to the target image data, sending a stay inquiry message to at least one of the intelligent doorbell or the terminal equipment, wherein the external personnel refer to personnel outside a preset household list; receiving a stay confirmation message from at least one of the smart doorbell or the terminal device; if the stay confirmation information is stay, executing the analysis result of determining whether all households associated with the intelligent doorbell are home or not according to the target image data; and if the stay confirmation information is not stay, executing the analysis result of determining whether all households associated with the intelligent doorbell are home or not according to the target image data after the foreign personnel are detected to leave.

In the case of integrated units, the functional unit composition block diagram of the data processing apparatus provided in the embodiment of the present application is shown in fig. 5 b. In fig. 5b, the data processing device 70 includes: a first processing module 720 and a first communication module 710. The first processing module 720 is configured to control and manage actions of the data processing apparatus, e.g., the steps performed by the acquisition unit 610, the determination unit 620, and/or other processes for performing the techniques described herein. The first communication module 710 is used to support interactions between the data processing apparatus 70 and other devices. As shown in fig. 5b, the data processing device 70 may further comprise a first storage module 730, the first storage module 730 being configured to store program code and data of the data processing device 70.

The first processing module 720 may be a processor or controller, such as a central processing unit (Central Processing Unit, CPU), a general purpose processor, a digital signal processor (Digital Signal Processor, DSP), an ASIC, FPGA or other programmable logic device, transistor logic device, hardware components, or any combination thereof. Which may implement or perform the various exemplary logic blocks, modules and circuits described in connection with the disclosure of embodiments of the present application. The processor may also be a combination that performs the function of a computation, e.g., a combination comprising one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The first communication module 710 may be a transceiver, an RF circuit, a communication interface, or the like. The first storage module 730 may be a memory.

All relevant contents of each scenario related to the above method embodiment may be cited to the functional description of the corresponding functional module, which is not described herein. The data processing apparatus may perform the steps performed by the server in the data processing method shown in fig. 2.

Fig. 6a is a functional unit block diagram of a data processing apparatus according to an embodiment of the present application. The data processing device 80 may be applied to a smart doorbell in a doorbell system as shown in fig. 1a or 1b, the data processing device 80 comprising:

The acquisition unit 810 is configured to acquire image information in real time, and send the image information to the server, where the image information is image information in a monitoring range acquired by the intelligent doorbell;

the receiving unit 820 is configured to receive a security reminder from the server, and broadcast, in response to the security reminder, a security prompt content corresponding to the security reminder, where the security prompt content is configured to prompt a user to perform an anti-theft measure, the security reminder is a content sent when the server determines, according to target image data, whether an analysis result of whether all households associated with the smart doorbell are home, is that of a whole person, and the target image data is a set of image information acquired in real time by the smart doorbell in a preset time period;

In the case of integrated units, the functional unit composition block diagram of the data processing apparatus provided in the embodiment of the present application is shown in fig. 6 b. In fig. 6b, the data processing device 90 includes: a second processing module 920 and a second communication module 910. The second processing module 920 is configured to control and manage actions of the data processing apparatus, e.g., steps performed by the acquisition unit 810, the receiving unit 820, and/or other processes for performing the techniques described herein. The second communication module 910 is used to support interactions between the data processing apparatus 90 and other devices. As shown in fig. 6b, the data processing device 90 may further comprise a second storage module 930, the second storage module 930 being configured to store program code and data of the data processing device 90.

The second processing module 920 may be a processor or controller, such as a central processing unit (Central Processing Unit, CPU), a general purpose processor, a digital signal processor (Digital Signal Processor, DSP), an ASIC, FPGA or other programmable logic device, transistor logic device, hardware components, or any combination thereof. Which may implement or perform the various exemplary logic blocks, modules and circuits described in connection with the disclosure of embodiments of the present application. The processor may also be a combination that performs the function of a computation, e.g., a combination comprising one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The second communication module 910 may be a transceiver, an RF circuit, or a communication interface, etc. The second storage module 930 may be a memory.

All relevant contents of each scenario related to the above method embodiment may be cited to the functional description of the corresponding functional module, which is not described herein. The data processing device may perform the steps performed by the smart doorbell in the data processing method shown in fig. 4.

The embodiment of the application also provides a computer storage medium, where the computer storage medium stores a computer program for electronic data exchange, where the computer program causes a computer to execute part or all of the steps of any one of the methods described in the embodiments of the method, where the computer includes a server.

It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of action combinations, but it should be understood by those skilled in the art that the present application is not limited by the order of actions described, as some steps may be performed in other order or simultaneously in accordance with the present application. Further, those skilled in the art will also appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily required in the present application.

In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to related descriptions of other embodiments.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, such as the above-described division of units, merely a division of logic functions, and there may be additional manners of dividing in actual implementation, such as multiple units or components may be combined or integrated into another system, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, or may be in electrical or other forms.

The units described above as separate components may or may not be physically separate, and components shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units described above, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a memory, including several instructions for causing a computer device (which may be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the above-mentioned method of the various embodiments of the present application. And the aforementioned memory includes: a U-disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a removable hard disk, a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Those of ordinary skill in the art will appreciate that all or a portion of the steps in the various methods of the above embodiments may be implemented by a program that instructs associated hardware, and the program may be stored in a computer readable memory, which may include: flash disk, read-Only Memory (ROM), random access Memory (Random Access Memory, RAM), magnetic disk or optical disk.

The foregoing has outlined rather broadly the more detailed description of embodiments of the present application, wherein specific examples are provided herein to illustrate the principles and embodiments of the present application, the above examples being provided solely to assist in the understanding of the methods of the present application and the core ideas thereof; meanwhile, as those skilled in the art will have modifications in the specific embodiments and application scope in accordance with the ideas of the present application, the present description should not be construed as limiting the present application in view of the above.

Claims

1. A data processing method, characterized by being applied to a server in a doorbell system, the doorbell system comprising the server, a smart doorbell, and a terminal device, the method comprising:

2. The method of claim 1, wherein the determining, from the target image data, an analysis of whether all households associated with the smart doorbell are home, comprises:

3. The method of claim 2, wherein the determining a target image segment from the target image data comprises:

4. The method of claim 3, wherein the character information includes dressing information, makeup information, body type information, and ceremony information, and the screening the second image segment corresponding to the first resident from the indeterminate image segments according to the character information of the first resident comprises:

5. The method of claim 4, wherein the weight parameters comprise:

6. The method of any of claims 1-5, wherein prior to determining the analysis of whether all households associated with the smart doorbell are home based on the target image data, the method further comprises:

7. A data processing method, characterized by being applied to an intelligent doorbell in a doorbell system, the doorbell system comprising a server, the intelligent doorbell, and a terminal device, the method comprising:

8. A data processing apparatus for use with a server in a doorbell system, the doorbell system comprising the server, a smart doorbell, and a terminal device, the apparatus comprising:

9. An electronic device comprising a processor, a memory, a communication interface, and one or more programs stored in the memory and configured to be executed by the processor, the programs comprising instructions for performing the steps in the method of any of claims 1-7.

10. A computer-readable storage medium, characterized in that a computer program for electronic data exchange is stored, wherein the computer program causes a computer to perform the steps in the method according to any one of claims 1-7.