CN114189662A

CN114189662A - Data interaction method and device and computer readable medium

Info

Publication number: CN114189662A
Application number: CN202210144172.0A
Authority: CN
Inventors: 刘发元; 刘达生; 林晓彬; 刘楠城
Original assignee: Yunding Network Technology Beijing Co Ltd
Current assignee: Yunding Network Technology Beijing Co Ltd
Priority date: 2022-02-17
Filing date: 2022-02-17
Publication date: 2022-03-15

Abstract

The embodiment of the application discloses a data interaction method, a data interaction device and a computer readable medium. The method is applied to a data interaction device, the data interaction device comprises an outdoor device and an indoor device, the outdoor device comprises an outdoor camera, an outdoor sound pickup, an outdoor display screen and an outdoor controller, the indoor device comprises an indoor display screen, an indoor loudspeaker and an indoor controller, and the method comprises the following steps: the outdoor controller controls the outdoor display screen to display the message guiding information; the outdoor controller responds to the message instruction to control the outdoor camera to collect the message image outside the door and control the outdoor sound pickup to collect the message sound outside the door, so as to obtain message data comprising the message image and the message sound; the outdoor controller sends the message data to the indoor controller; and the indoor controller responds to the message checking instruction, sends the message image to the indoor display screen for displaying, and sends the message sound to the indoor loudspeaker for outputting. The message leaving effect is improved.

Description

Data interaction method and device and computer readable medium

Technical Field

The embodiment of the application relates to the technical field of data interaction, in particular to a data interaction method, a data interaction device and a computer readable medium.

Background

An electronic peephole is an electronic device that can help a resident in a house to view an outdoor environment. With the development of science and technology, some electronic cat eyes can provide a message leaving function.

The specific method for realizing the message leaving function of the current electronic peephole is as follows: if the visitor finds that no one is in the room, a message leaving key on the electronic cat eye is pressed to control the electronic cat eye to start recording, and the visitor can leave a message after the electronic cat eye starts recording.

However, the current message leaving method cannot achieve a good message leaving effect.

Disclosure of Invention

The embodiment of the application provides a data interaction method, a data interaction device and a computer readable medium.

In a first aspect, an embodiment of the present application provides a data interaction method, which is applied to a data interaction device, where the data interaction device includes an outdoor device and an indoor device, the outdoor device includes an outdoor camera, an outdoor pickup, an outdoor display screen and an outdoor controller, the indoor device includes an indoor display screen, an indoor speaker and an indoor controller, and the method includes:

the outdoor controller controls the outdoor display screen to display message guiding information;

the outdoor controller responds to a message instruction to control the outdoor camera to collect the message image outside the door and control the outdoor sound pickup to collect the message sound outside the door, so that message data comprising the message image and the message sound is obtained;

the outdoor controller sends the message data to the indoor controller;

and the indoor controller responds to a message viewing instruction, sends the message image to the indoor display screen for displaying, and sends the message sound to the indoor loudspeaker for outputting.

In some embodiments, the in-door apparatus further comprises an in-door camera, the method further comprising:

the outdoor controller responds to an indoor information viewing instruction carrying a user identifier and identifies the user identifier;

under the condition that the user identification is the user identification of the authenticated user, the door external controller sends the door internal information viewing instruction to the door internal controller;

the indoor controller responds to the indoor information viewing instruction and controls the indoor camera to collect indoor images;

the in-door controller transmits the in-door image to the out-door controller;

and the outdoor controller sends the images in the door to the outdoor display screen for display.

In some embodiments, the in-door apparatus further comprises an in-door camera and an in-door pickup, the method further comprising:

the indoor controller responds to the message guiding acquisition instruction, controls the indoor camera to acquire indoor images to obtain message guiding images, and controls the indoor sound pickup to acquire indoor sound to obtain message guiding sound;

and the indoor controller obtains message guiding information based on the message guiding image and the message guiding sound and sends the message guiding information to the outdoor controller.

In some embodiments, the in-door controller obtains message guidance information based on the message guidance image and the message guidance sound, including:

the in-door controller processes a background image in the message guide image to change image characteristic information carried by the background image;

and/or the presence of a gas in the gas,

the in-door controller processes the character image in the message guide image to change the image characteristic information carried by the character image;

and/or the presence of a gas in the gas,

the indoor controller processes background sound in the message guide sound to change sound characteristic information carried by the background sound;

and/or the presence of a gas in the gas,

and the in-door controller processes the character voice in the message guiding voice so as to change the voice characteristic information carried by the character voice.

In some embodiments, the method further comprises:

the indoor controller responds to an outdoor scene viewing instruction, wakes up the indoor display screen and sends an image acquisition request to the outdoor controller;

the outdoor controller responds to the image acquisition request, controls the outdoor camera to acquire an outdoor image and sends the outdoor image to the indoor controller;

and the indoor controller sends the outdoor image to the indoor display screen for display.

In some embodiments, the in-door controller and the out-door controller establish a communication connection using a default key and encrypt transmitted data using the default key, the method further comprising:

the indoor controller sends a key replacement request to the outdoor controller, the indoor controller generates a new key, encrypts the new key by using the default key and sends the encrypted new key to the outdoor controller;

the outdoor controller responds to the key replacing request, waits for and receives the encrypted new key, and decrypts the encrypted new key by using the default key to obtain the new key;

the door external controller sends a preset response to the door internal controller;

and after the indoor controller receives the preset response, the indoor controller and the outdoor controller reestablish connection by using the new secret key and encrypt the transmitted data by using the new secret key.

In some embodiments, the in-door controller and the out-door controller establish a communication connection using a target key and encrypt transmitted data using the target key, the method further comprising:

in the case that the indoor controller and the outdoor controller fail to establish communication connection by using the target key, the indoor controller establishes communication connection with the outdoor controller by using a default key in response to an equipment replacement instruction;

In a second aspect, an embodiment of the present application provides a data interaction device, the data interaction device includes outdoor equipment and indoor equipment, outdoor equipment includes outdoor camera, outdoor adapter, outdoor display screen and outdoor controller, indoor equipment includes indoor display screen, indoor speaker and indoor controller, the outdoor controller includes: guide the control unit, first collection control unit and first message sending unit, the interior controller includes: a first display control unit for controlling the display of the display panel,

the guide control unit is used for controlling the display screen outside the door to display message guide information;

the first acquisition control unit is used for responding to a message instruction to control the outdoor camera to acquire the message image outside the door and control the outdoor sound pickup to acquire the message sound outside the door so as to obtain message data comprising the message image and the message sound;

the first message sending unit is used for sending the message data to the indoor controller;

and the first display control unit is used for responding to a message viewing instruction, sending the message image to the indoor display screen for displaying, and sending the message sound to the indoor loudspeaker for outputting.

In some embodiments, the in-door apparatus further comprises an in-door camera, and the out-door controller further comprises: the identification element, look over order sending unit and second display control unit, the controller still includes in the door: a second acquisition control unit for controlling the acquisition of the image,

the identification unit is used for responding to an in-door information viewing instruction carrying a user identifier and identifying the user identifier;

the check instruction sending unit is used for sending the in-door information check instruction to the in-door controller under the condition that the user identifier is the user identifier of the authenticated user;

the second acquisition control unit is used for responding to the in-door information viewing instruction, controlling the in-door camera to acquire an in-door image and sending the in-door image to the out-door controller;

and the second display control unit is used for sending the images in the door to the display screen outside the door for display.

In a third aspect, the present application provides a computer-readable medium, on which a computer program is stored, where the program, when executed by a controller, implements the method as described in any implementation manner of the first aspect.

In a fourth aspect, the present application provides a controller, where the controller is configured to execute a program, where the program executes to perform the method described in any implementation manner of the first aspect.

In a fifth aspect, an embodiment of the present application provides an electronic device, including: one or more controllers; a storage device having one or more programs stored thereon; the one or more programs, when executed by the one or more controllers, cause the one or more controllers to implement the method as described in any implementation of the first aspect.

The data interaction method, the data interaction device and the computer readable medium provided by the embodiment of the application can display the message-leaving guide information through the display screen outside the door, so that the visitor is guided to leave a message through the content displayed by the display screen, and the message-leaving effect is effectively improved. Meanwhile, each controller is arranged inside and outside the door, so that each controller only needs to process part of processing procedures in the data interaction method of the embodiment of the application, and the operation burden of the controllers is effectively reduced. Meanwhile, the indoor controller can also send the message image to the indoor display screen for display and send the message sound to the indoor loudspeaker for output, so that indoor residents can conveniently check the messages of visitors, and the message effect is further improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It is obvious that the drawings in the following description are only some examples or embodiments of the present application, and that for a person skilled in the art, other drawings can be obtained from the provided drawings without inventive effort, and that the present application can also be applied to other similar scenarios from the provided drawings. Unless otherwise apparent from the context, or otherwise indicated, like reference numbers in the figures refer to the same structure or operation.

FIG. 1 is an exemplary system architecture diagram to which some embodiments of the present application may be applied;

FIG. 2 is yet another exemplary system architecture diagram to which some embodiments of the present application may be applied;

FIG. 3 is yet another exemplary system architecture diagram to which some embodiments of the present application may be applied;

FIG. 4 is a flow diagram of one embodiment of a data interaction method according to the present application;

FIG. 5 is a flow diagram of yet another embodiment of a data interaction method according to the present application;

FIG. 6 is a flow diagram of yet another embodiment of a data interaction method according to the present application;

FIG. 7 is a flow diagram of yet another embodiment of a data interaction method according to the present application;

FIG. 8 is a flow diagram of yet another embodiment of a data interaction method according to the present application;

FIG. 9 is a flow diagram of yet another embodiment of a data interaction method according to the present application;

FIG. 10 is a schematic block diagram of one embodiment of a data interaction device according to the present application;

FIG. 11 is a schematic block diagram of an electronic device suitable for use in implementing some embodiments of the present application.

Detailed Description

The present application will be described in further detail with reference to the following drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the relevant invention and not restrictive of the invention. The described embodiments are only some embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings. The embodiments and features of the embodiments in the present application may be combined with each other without conflict.

It should be understood that "system", "apparatus", "unit" and/or "module" as used herein is a method for distinguishing different components, elements, parts or assemblies at different levels. However, other words may be substituted by other expressions if they accomplish the same purpose.

As used in this application and the appended claims, the terms "a," "an," "the," and/or "the" are not intended to be inclusive in the singular, but rather are intended to be inclusive in the plural unless the context clearly dictates otherwise. In general, the terms "comprises" and "comprising" merely indicate that steps and elements are included which are explicitly identified, that the steps and elements do not form an exclusive list, and that a method or apparatus may include other steps or elements. An element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.

In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" herein is merely an association describing an associated object, and means that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. In addition, in the description of the embodiments of the present application, "a plurality" means two or more than two.

In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature.

Flow charts are used herein to illustrate operations performed by systems according to embodiments of the present application. It should be understood that the preceding or following operations are not necessarily performed in the exact order in which they are performed. Rather, the various steps may be processed in reverse order or simultaneously. Meanwhile, other operations may be added to the processes, or a certain step or several steps of operations may be removed from the processes.

Fig. 1 illustrates an exemplary system architecture to which some embodiments of the data interaction method or data interaction apparatus of the present application may be applied.

As shown in fig. 1, the system architecture may include an outdoor device 110 and an indoor device 120, the outdoor device 110 may include an outdoor camera 111, an outdoor microphone 112, an outdoor display screen 113, and an outdoor controller 114, and the indoor device 120 includes an indoor display screen 121, an indoor speaker 122, and an indoor controller 123. The out-door controller 114 and the in-door controller 123 may be communicatively coupled via a network 130, and the network 130 may include various types of connections, such as wired, wireless communication links, or fiber optic cables, among others.

The outdoor controller 114 may be in communication connection with the outdoor camera 111, the outdoor sound pickup 112, and the outdoor display screen 113, respectively. The in-door controller 123 may be communicatively connected to the in-door display screen 121 and the in-door speaker 122, respectively.

Alternatively, the "inside" and "outside" of the system architecture shown in fig. 1 can be understood as two areas, i.e., inside and outside, formed by the entrance door. Currently, the door may be a room door in a room, or other doors (e.g., an elevator door, an outdoor door, etc.) besides a door for entering the room.

A user may interact with the in-door apparatus 120 using the out-door apparatus 110 and may also interact with the out-door apparatus 110 using the in-door apparatus 120. Various client applications, such as a door entry application, a message leaving application, a door lock application, a cat eye application, a video application, etc., may be installed on the out-door controller 114 and/or the in-door controller 123.

The outdoor camera 111 is a camera for collecting outdoor images, and the outdoor camera 111 of the present application does not indicate or limit its installation position to be located outdoors. It is understood that the door outer camera 111 may be mounted on the door, and the lens end faces the outside of the door to capture the door outer image. Of course, in an embodiment, the door outer camera 111 may be disposed outside the door.

The outdoor microphone 112 may be a microphone for collecting outdoor sounds, and the outdoor microphone 112 of the present application does not indicate or limit its installation position outside the door.

The outdoor display screen 113 may be a display screen disposed on an outer side surface of the door or a wall surface outside the door, and the outdoor display screen 113 may be a touch screen.

The door controller 114 does not indicate or limit the installation position to be located outside the door, and the door controller 114 may be provided in the door body, may be provided inside the door, or may be provided outside the door. Alternatively, the outdoor controller 114 may be integrated into other devices included in the outdoor device 110, such as: the outdoor controller 114 may be integrated in the outdoor display screen 113 or integrated in the outdoor camera 111.

The in-door speaker 122 may be a device for playing sound into the door, and the in-door speaker 122 of the present application is not intended to indicate or limit its installation location within the door.

The in-door display screen 121 may be a display screen disposed on an inner side surface of the door or a wall surface disposed in the door, and the in-door display screen 121 may be a touch screen.

The indoor controller 123 does not indicate or limit the installation position thereof to be located inside the door, and the indoor controller 123 may be provided in the door body, may be provided inside the door, or may be provided outside the door. Alternatively, the in-door controller 123 may be integrated into other devices included in the in-door device 120, such as: the in-door controller 123 may be integrated into the in-door display screen 121 or integrated into the in-door speakers 122.

Fig. 2 shows an exemplary system architecture to which further embodiments of the data interaction method or the data interaction device of the present application may be applied.

With respect to the system architecture shown in fig. 1, as shown in fig. 2, the in-door apparatus 120 may further include: an in-door camera 124 and/or an in-door pickup 125.

The in-door camera 124 is used for collecting image information in the door, and the in-door camera 124 of the present application does not indicate or limit the installation position thereof in the door.

The in-door pickup 125 is used to collect sound information in the door, and the in-door pickup 125 of the present application is not intended to indicate or limit its installation location within the door.

The in-door camera 124 and the in-door pickup 125 may be communicatively connected to the in-door controller 123.

Fig. 3 shows an exemplary system architecture to which further embodiments of the data interaction method or data interaction device of the present application may be applied.

With respect to the system architecture shown in fig. 1, as shown in fig. 3, the out-door device 110 may further include: an out door speaker 115.

The outdoor speaker 115 is used to play sound outdoors, and the outdoor speaker 115 of the present application does not indicate or limit its installation position outside the door.

With continued reference to FIG. 4, a flow diagram of one embodiment of a data interaction method in accordance with the present application is shown. The data interaction method is applied to any one of the data interaction devices shown in fig. 1 to 3, the data interaction device comprises an outdoor device 110 and an indoor device 120, the outdoor device 110 comprises an outdoor camera 111, an outdoor sound pickup 112, an outdoor display screen 113 and an outdoor controller 114, the indoor device 120 comprises an indoor display screen 121, an indoor loudspeaker 122 and an indoor controller 123, and the data interaction method comprises the following steps:

in step 401, the outdoor controller 114 controls the outdoor display 113 to display the message guidance information.

Optionally, step 401 may be performed in some cases, for example: when the outdoor controller 114 obtains the message instruction, step 401 is executed; the following steps are repeated: the out-door controller 114 executes step 401 when it determines that no one inside the door answers the visitor outside the door; the following steps are repeated: the out-door controller 114 determines that there is a visitor out of the door and the current mode of operation is: in-door unmanned mode.

The message instruction may be obtained by: and obtaining the message leaving instruction according to any one of a plurality of operations of pressing a message leaving key, operating a touch screen, giving a voice instruction, giving a gesture instruction and the like by a user.

Alternatively, the process of the out-door controller 114 determining that no one inside the door answers the visitor outside the door may include:

the out-of-door controller 114 determines whether a visitor out of the door issues a target action, including: a knock action and/or a doorbell action;

after determining that the visitor outside the door sends the target action, the controller 114 determines whether the visitor inside the door responds within a preset time after the visitor sends the target action, and if no person responds, the controller 114 determines that no person inside the door responds to the visitor outside the door.

The outdoor controller 114 may collect a vibration signal of the door body based on a vibration sensor provided on the door body, compare the collected vibration signal with a pre-stored door-knocking vibration signal, and determine that an visitor outside the door makes a door-knocking action if the similarity is greater than a preset similarity threshold.

Of course, the outdoor controller 114 may also collect an outdoor sound signal through the outdoor sound pickup 112, compare the collected sound signal with a prestored door-knocking sound signal, and determine that the visitor outside the door makes a door-knocking action if the similarity is greater than the preset similarity threshold.

Of course, the outdoor controller 114 may also collect the sound signal inside the door through the indoor sound pickup 125 shown in fig. 2, compare the collected sound signal with the prestored doorbell sound signal, and determine that the visitor outside the door makes a doorbell operation if the similarity is greater than the preset similarity threshold. Of course, the external door controller 114 may also be communicatively connected to the electronic doorbell, and when the electronic doorbell is pressed, the external door controller 114 may determine that the visitor outside the door sends a doorbell pressing action.

The out-door controller 114 can determine whether a visitor outside the door is answered in the door based on the signal sent by the in-door controller 123. A resident inside the door may respond to a visitor outside the door with at least one of the devices inside the door display screen 121, the inside door camera 124, the inside door pickup 125, etc. Because the indoor display screen 121, the indoor camera 124 and the indoor sound pickup 125 are all in communication connection with the indoor controller 123, the indoor controller 123 can send response signals sent by the indoor resident through the indoor display screen 121, the indoor camera 124 and the indoor sound pickup 125 to the outdoor controller 114, so that the outdoor controller 114 can determine that someone in the door answers an visitor outside the door when receiving the response signals.

The above-mentioned nobody mode in the door may be a working mode when nobody is in the door, or a working mode set by an authenticated user (no matter whether someone is in the door).

The mode of determining that there is a visitor outside the door by the outdoor controller 114 is various, such as collecting an infrared signal, identifying an outdoor image, and the like, which is not limited in this embodiment of the application.

The message guide information may be information for guiding the visitor to leave access information, and the message guide information may include: at least one of various forms of information such as video, animation, text, graphics, and the like, which is not limited in this application. Of course, the message guide information may further include sound information so that the message guide information may output an image and a sound through the outdoor display screen 113 and the outdoor speaker 115, respectively.

Optionally, the message guidance information may be recorded by the householder in advance.

Step 402, the outdoor controller 114 responds to the message instruction to control the outdoor camera 111 to collect the message image outside the door, and controls the outdoor sound pickup 112 to collect the message sound outside the door, so as to obtain the message data including the message image and the message sound.

In step 403, the out-door controller 114 sends the message data to the in-door controller 123.

The outdoor controller 114 may first encrypt the message data and then transmit the encrypted message data to the indoor controller 123, so as to improve the security of data transmission.

In step 404, the in-door controller 123 responds to the message viewing instruction, sends the message image to the in-door display screen 121 for display, and sends the message sound to the in-door speaker 122 for output.

After receiving the message data, the in-door controller 123 may store the message data in a memory, or may send the message data to a network-side device, such as a server.

The obtaining mode of the message viewing instruction may be: and obtaining the message viewing instruction according to any one of a plurality of operations of pressing a message viewing key, operating a touch screen, giving a voice instruction, giving a gesture instruction and the like by a user.

According to the data interaction method provided by the embodiment of the application, the message-leaving guide information can be displayed through the display screen outside the door, so that the visitor is guided to leave a message through the content displayed by the display screen, and the message-leaving effect is effectively improved. Meanwhile, each controller is arranged inside and outside the door, so that each controller only needs to process part of processing procedures in the data interaction method of the embodiment of the application, and the operation burden of the controllers is effectively reduced. Meanwhile, the indoor controller can also send the message image to the indoor display screen for display and send the message sound to the indoor loudspeaker for output, so that the householder in the door can conveniently check the message of the visitor, and the message effect is further improved.

With continued reference to FIG. 5, a flow diagram of yet another embodiment of a data interaction method in accordance with the present application is shown. The data interaction method is applied to the data interaction device shown in fig. 2, as shown in fig. 2, the in-door apparatus 120 further includes an in-door camera 124, as shown in fig. 5, and with respect to the method shown in fig. 4, the data interaction method further includes:

in step 501, the out-door controller 114 responds to the in-door information viewing instruction carrying the user identifier to identify the user identifier.

The user identifier may be information for identifying the user identity, such as facial features, iris features, fingerprint features, voice features, account number and password.

The obtaining mode of the in-door information viewing instruction can be as follows: the in-door information viewing instruction is obtained according to any one of a plurality of operations of pressing a target key, operating a touch screen, giving a voice instruction, giving a gesture instruction and the like of a visitor outside the door. Before performing the above operation, the visitor outside the door may first perform user identification collection, so that the visitor outside the door obtains the user identification of the visitor outside the door by the door controller 114. Optionally, the user identifier collecting may include: at least one of face feature collection, iris feature collection, fingerprint feature collection, voice feature collection and account password collection.

In step 502, in the case that the user identifier is the user identifier of the authenticated user, the out-door controller 114 sends an in-door information viewing instruction to the in-door controller 123.

The embodiment of the application can store the user identification of the authenticated user in advance. Therefore, the user identification carried by the in-door information checking instruction and the user identification of the authenticated user can be compared, so that whether the user identification carried by the in-door information checking instruction is the user identification of the authenticated user or not is determined.

In step 503, the in-door controller 123 responds to the in-door information viewing instruction, and controls the in-door camera 124 to collect the in-door image.

At step 504, the in-door controller 123 sends the in-door image to the out-door controller 114.

In step 505, the door controller 114 sends the images in the door to the door display 113 for display.

The embodiment shown in fig. 5 enables the authenticated user to view the indoor information from the outside of the door, so that the authenticated user can conveniently and timely know the indoor images without opening the door, and the method is convenient and fast.

With continued reference to FIG. 6, a flow diagram of yet another embodiment of a data interaction method in accordance with the present application is shown. The data interaction method is applied to the data interaction device shown in fig. 2, as shown in fig. 2, the in-door apparatus 120 further includes an in-door camera 124 and an in-door microphone 125, as shown in fig. 6, and with respect to the method shown in fig. 4, the data interaction method further includes:

in step 601, the in-door controller 123 responds to the message guidance collecting instruction, controls the in-door camera 124 to collect the in-door image to obtain a message guidance image, and controls the in-door microphone 125 to collect the in-door sound to obtain a message guidance sound.

The obtaining mode of the message guiding acquisition instruction can be as follows: the message guiding and collecting instruction is obtained according to any one of a plurality of operations such as pressing a guiding and collecting key, operating a touch screen, sending a voice instruction and sending a gesture instruction of a resident in a door.

Through step 601, the in-door device 120 may record a message guidance video (including a message guidance image and a message guidance sound), which is message guidance information.

In step 602, the in-door controller 123 obtains the message guidance information based on the message guidance image and the message guidance sound, and sends the message guidance information to the out-door controller 114.

The embodiment shown in fig. 6 can help the householder in the house to record the message guide video, so as to realize personalization of message guide, and the householder in the house can conveniently modify the message guide video, so as to provide more and/or clearer information for the visitor out of the house, and further improve the message effect of the visitor.

In another embodiment, in the step 602, in the process that the in-door controller 123 obtains the message guiding information based on the message guiding image and the message guiding sound, the message guiding image and/or the message guiding sound may be processed to change the characteristic information carried by the message guiding image and/or the message guiding sound. Specifically, the processing of the message guiding image and/or the message guiding sound may include at least one of the following four modes:

in the first mode, the in-door controller 123 processes the background image in the message guide image to change the image feature information carried by the background image.

In the second mode, the in-door controller 123 processes the personal image in the message guide image to change the image feature information carried by the personal image.

In the third mode, the in-door controller 123 processes the background sound in the message guidance sound to change the sound feature information carried by the background sound.

In the fourth embodiment, the in-door controller 123 processes the personal sound in the message guidance sound to change the sound feature information carried by the personal sound.

The modification of the above four modes may include: at least one of the modification modes such as reduction, addition and replacement.

Through the four modes, the embodiment of the application can change the images and/or the sounds collected in the door. By performing the modification processing, sensitive information or information irrelevant to message guidance can be reduced or even removed from the message guidance image and/or the message guidance sound. Of course, the above modification process may also implement other functions, such as: by changing the gender feature information of the character voice, the visitor cannot determine the real gender of the resident in the house through the message guiding voice.

With continued reference to FIG. 7, a flow diagram of yet another embodiment of a data interaction method in accordance with the present application is shown. The data interaction method is applied to any one of the data interaction devices shown in fig. 1 to 3, as shown in fig. 7, and with respect to the method shown in fig. 4, the data interaction method further includes:

in step 701, the in-door controller 123 wakes up the in-door display screen 121 in response to the out-door scene viewing instruction, and sends an image acquisition request to the out-door controller 114.

Optionally, if the internal door display screen 121 does not receive a new display instruction within the preset time period, the internal door display screen 121 may enter the sleep mode to reduce energy consumption. Of course, the in-door display screen 121 may also enter the sleep-mode according to other manners, which is not limited in this embodiment of the application.

In step 702, the outdoor controller 114 controls the outdoor camera 111 to capture an outdoor image and send the outdoor image to the indoor controller 123 in response to the image acquisition request.

Optionally, step 702 may control the outdoor camera 111 to acquire an outdoor image and send the outdoor image to the indoor controller 123 based on a Real Time Streaming Protocol (RTSP).

In step 703, the in-door controller 123 sends the out-door image to the in-door display screen 121 for display.

Steps 701 to 703 can realize the effect of viewing the real-time images from inside to outside of the door.

With continued reference to FIG. 8, a flow diagram of yet another embodiment of a data interaction method in accordance with the present application is shown. The data interaction method is applied to any one of the data interaction devices shown in fig. 1 to 3, in the data interaction method, the in-door controller 123 and the out-door controller 114 establish a communication connection using a default key and encrypt transmitted data using the default key, as shown in fig. 8, and with respect to the method shown in fig. 4, the data interaction method further includes:

in step 801, the in-door controller 123 sends a key exchange request to the out-door controller 114, the in-door controller 123 generates a new key, encrypts the new key with a default key, and sends the encrypted new key to the out-door controller 114.

The in-door controller 123 and the out-door controller 114 may establish a communication connection using a default key based on a Transmission Control Protocol (TCP).

The indoor controller 123 and the outdoor controller 114 establish communication connection by using the default key and encrypt the transmitted data by using the default key, so that the security of the data transmitted by the indoor controller 123 and the outdoor controller 114 can be effectively improved. Security can be further improved if the default key is modified.

The in-door controller 123 may generate the new key in a variety of ways, such as a random number generation algorithm, a new key generated based on the device identification of the in-door device 120 and the current time, etc. Specifically, the present embodiment may obtain a hash value of a character group formed by the device identifier of the in-door device 120 and the current time using a hash algorithm, and use the hash value as a new key.

By encrypting the new key by using the default key, the transmission security of the new key can be effectively improved.

In step 802, the out-door controller 114, in response to the key exchange request, waits for and receives the encrypted new key, and decrypts the encrypted new key using the default key to obtain the new key.

In step 803, the out-door controller 114 sends a preset response to the in-door controller 123.

The pre-set response may be used to indicate that the out-door controller 114 has successfully obtained the new key.

In step 804, after the in-door controller 123 receives the preset response, the in-door controller 123 and the out-door controller 114 reestablish the connection using the new key and encrypt the transmitted data using the new key.

The manner in which the in-door controller 123 and the out-door controller 114 establish a connection using the new key may be the same as the manner in which the in-door controller 123 and the out-door controller 114 establish a connection using the default key.

Steps 801 to 804 may replace the default key with a new key, reestablish a connection using the new key, and encrypt the transmitted data using the new key, which effectively improves the security of the data.

With continued reference to FIG. 9, a flow diagram of yet another embodiment of a data interaction method in accordance with the present application is shown. The data interaction method is applied to any one of the data interaction devices shown in fig. 1 to 3, in the data interaction method, the in-door controller 123 and the out-door controller 114 establish a communication connection using a target key and encrypt transmitted data using the target key, as shown in fig. 9, and with respect to the method shown in fig. 4, the data interaction method further includes:

in step 901, in the case where the in-door controller 123 and the out-door controller 114 fail to establish a communication connection using the target key, the in-door controller 123 establishes a communication connection with the out-door controller 114 using a default key in response to the device replacement instruction.

The target key is a currently valid key, and the currently valid key may be a default key or a new key for replacing the default key.

The reason why the in-door controller 123 and the out-door controller 114 fail to establish the communication connection using the target key may be that at least one of the out-door apparatus 110 and the in-door apparatus 120 is changed. At this point, it is necessary to generate a new key and establish a connection based on the new key.

Step 902, the in-door controller 123 sends a key exchange request to the out-door controller 114, the in-door controller 123 generates a new key, encrypts the new key with a default key, and sends the encrypted new key to the out-door controller 114.

In step 903, the out-door controller 114 waits for and receives the encrypted new key in response to the key exchange request, and decrypts the encrypted new key using the default key to obtain the new key.

At step 904, the out-door controller 114 sends a preset response to the in-door controller 123.

In step 905, after the in-door controller 123 receives the preset response, the in-door controller 123 and the out-door controller 114 reestablish the connection using the new key and encrypt the transmitted data using the new key.

Step 902 is similar to step 801 shown in fig. 8, step 903 is similar to step 802 shown in fig. 8, step 904 is similar to step 803 shown in fig. 8, step 905 is similar to step 804 shown in fig. 8, and the detailed description of steps 902 to 904 refers to the embodiment shown in fig. 8.

The embodiment shown in fig. 9 can reestablish the connection after at least one of the outdoor device 110 and the indoor device 120 is changed, and solves the problem of connection failure caused by device replacement.

In other embodiments of the present application, the door inner display screen 121 and/or the door outer display screen 113 may also display various information or interfaces, such as: graphical User Interfaces (GUI), notification information, weather, temperature, humidity, notes, etc.

Optionally, the number of the outdoor cameras 111 in the embodiments of the present application may be one or more, and the installation position and the orientation of each outdoor camera 111 may be the same or different.

Alternatively, the number of the in-door cameras 124 in the embodiments of the present application may be one or more, and the installation position and orientation of each in-door camera 124 may be the same or different.

Through a plurality of cameras of mounted position and/or orientation difference, this application embodiment can follow different angles and gather image information for the information of gathering is more accurate and abundant.

Optionally, the outdoor display 113 and/or the indoor display 121 in the embodiments of the present application need to be woken up before displaying the image. The specific wake-up mode may be: and if the person approaches the display screen, awakening. Of course, other wake-up schemes are possible.

Optionally, the data transmission manner in the embodiments of the present application may be a transmission manner based on a server-client mode. Specifically, when the in-door controller 123 sends data to the out-door controller 114, the out-door controller 114 may serve as a client, and pull data from the in-door controller 123 serving as a server, so as to implement data transmission. Specifically, when the external door controller 114 sends data to the internal door controller 123, the internal door controller 123 may serve as a client, and pull data from the external door controller 114 serving as a server, so as to implement data transmission.

Optionally, in other embodiments of the present application, the outdoor controller 114 may further perform identity authentication based on an image collected by the outdoor camera 111, and control the electronic lock to unlock when the identity authentication passes. After the electronic lock is unlocked, the outdoor controller 114 may control the outdoor display 113 to display a prompt message indicating that the unlocking is successful. After the authentication is passed, the outdoor controller 114 may control the outdoor display 113 to display welcome information.

Optionally, after the identity authentication is passed, the outdoor controller 114 may further record the user entry information of the user passing the identity authentication, and count the user entry times and other information. The outdoor controller 114 may also send the recorded entrance information or various statistical information to the outdoor display 113 and/or the indoor display 121 for display.

Optionally, the door external display 113 may further display identification guidance information to guide the visitor to perform identification correctly, for example: the visitor is guided to stand in a proper position so that the door outer camera 111 captures a clear image of the face of the person.

Alternatively, the size of the door outer display 113 in the embodiments of the present application may be smaller than the size of the door inner display 121.

With further reference to fig. 10, as an implementation of the methods shown in some of the above figures, the present application provides an embodiment of a data interaction apparatus, which corresponds to the method embodiment shown in fig. 4, and which can be applied in various electronic devices.

As shown in fig. 10, the data interaction apparatus of this embodiment includes an outdoor device 110 and an indoor device 120, where the outdoor device 110 includes an outdoor camera 111, an outdoor sound pickup 112, an outdoor display screen 113 and an outdoor controller 114, the indoor device 120 includes an indoor display screen 121, an indoor speaker 122 and an indoor controller 123, and the outdoor controller 114 includes: a guidance control unit 1141, a first acquisition control unit 1142, and a first message sending unit 1143, wherein the in-door controller 123 includes: the first display control unit 1231.

The guidance control unit 1141 is configured to control the outdoor display screen to display message guidance information;

the first acquisition control unit 1142 is configured to control the outdoor camera to acquire a message image outdoors in response to a message instruction, and control the outdoor sound pickup to acquire a message sound outdoors, so as to obtain message data including the message image and the message sound;

the first message sending unit 1143 is configured to send the message data to the indoor controller;

the first display control unit 1231 is configured to send the message image to the in-door display screen for display in response to a message viewing instruction, and send the message sound to the in-door speaker for output.

In this embodiment, the specific processing of the guidance control unit 1141, the first acquisition control unit 1142, the first message sending unit 1143, and the first display control unit 1231 and the technical effects brought thereby may refer to the relevant descriptions of the embodiments of step 401, step 402, step 403, and step 404 in the corresponding embodiment of fig. 4, which are not described herein again.

In some optional implementations of this embodiment, the in-door device further includes an in-door camera, and the out-door controller further includes: the identification element, look over order sending unit and second display control unit, the controller still includes in the door: a second acquisition control unit for controlling the acquisition of the image,

In some optional implementations of this embodiment, the in-door apparatus further includes an in-door camera and an in-door pickup, and the in-door controller further includes: the message acquisition unit and the second message sending unit;

the message acquisition unit is used for responding to a message guide acquisition instruction, controlling the indoor camera to acquire indoor images to obtain message guide images, and controlling the indoor sound pickup to acquire indoor sound to obtain message guide sound;

and the second message sending unit is used for obtaining message guiding information based on the message guiding image and the message guiding sound and sending the message guiding information to the outdoor controller.

In some optional implementation manners of this embodiment, the second message sending unit includes: at least one of a first change subunit, a second change subunit, a third change subunit, and a fourth change subunit;

the first changing subunit is configured to process a background image in the message guide image to change image feature information carried by the background image;

the second changing subunit is configured to process the personal image in the message guide image to change image feature information carried by the personal image;

the third changing subunit is configured to process a background sound in the message guidance sound to change sound feature information carried by the background sound;

and the fourth changing subunit is configured to process the character sound in the message guiding sound to change the sound feature information carried by the character sound.

In some optional implementations of this embodiment, the in-door controller further includes: awaken up unit and third display control unit, the outer controller of door still includes: a third acquisition control unit for controlling the acquisition of the image,

the awakening unit is used for responding to an outdoor scene viewing instruction, awakening the indoor display screen and sending an image acquisition request to the outdoor controller;

the third acquisition control unit is used for responding to the image acquisition request, controlling the outdoor camera to acquire an outdoor image and sending the outdoor image to the indoor controller;

and the third display control unit is used for sending the images outside the door to the display screen inside the door for display.

In some optional implementations of this embodiment, the in-door controller and the out-door controller establish a communication connection using a default key and encrypt transmitted data using the default key, and the in-door controller further includes: a rekey requesting unit and a first reconnecting unit, the out-door controller including: a first response transmitting unit, a second reconnection unit, and a first decryption unit,

the key replacing request unit is used for sending a key replacing request to the outdoor controller, the indoor controller generates a new key, encrypts the new key by using the default key and sends the encrypted new key to the outdoor controller;

the first decryption unit is used for responding to the key change request, waiting for and receiving the encrypted new key, and decrypting the encrypted new key by using the default key to obtain the new key;

the first response sending unit is used for sending a preset response to the in-door controller;

and after the in-door controller receives the preset response, the first reconnection unit and the second reconnection unit reestablish connection by using the new secret key and encrypt the transmitted data by using the new secret key.

In some optional implementations of this embodiment, the in-door controller and the out-door controller establish a communication connection using a target key and encrypt transmitted data using the target key, and the in-door controller further includes: the connection establishes unit, key change unit and the third unit of reconnection, the out-of-door controller still includes: a second decryption unit, a second response transmission unit and a fourth reconnection unit,

the connection establishing unit is used for responding to an equipment replacing instruction and establishing communication connection with the controller outside the door by using a default key under the condition that the controller inside the door and the controller outside the door establish communication connection by using the target key;

the key replacing unit is used for sending a key replacing request to the controller outside the door, the controller inside the door generates a new key, encrypts the new key by using the default key and sends the encrypted new key to the controller outside the door;

the second decryption unit is configured to wait for and receive the encrypted new key in response to the key exchange request, and decrypt the encrypted new key using the default key to obtain the new key;

the second response sending unit is used for sending a preset response to the in-door controller;

and after the in-door controller receives the preset response, the third reconnection unit and the fourth reconnection unit reestablish connection by using the new key and encrypt the transmitted data by using the new key.

It should be noted that the guidance control unit 1141, the first collection control unit 1142, the first message sending unit 1143, the first display control unit 1231, and the like are all stored in the memory as program units, and the controller executes the program units stored in the memory to implement corresponding functions.

The controller may include a kernel, and the kernel calls the corresponding program unit from the memory. One or more kernels can be set, and each processing process of the data interaction method of the embodiment of the application is carried out by adjusting the kernel parameters.

The memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.

According to the data interaction device provided by the embodiment of the application, the message-leaving guide information is displayed through the display screen outside the door, so that the visitor is guided to leave a message through the content displayed by the display screen, and the message-leaving effect is effectively improved. Meanwhile, each controller is arranged inside and outside the door, so that each controller only needs to process part of processing procedures in the data interaction method of the embodiment of the application, and the operation burden of the controllers is effectively reduced. Meanwhile, the indoor controller can also send the message image to the indoor display screen for display and send the message sound to the indoor loudspeaker for output, so that the householder in the door can conveniently check the message of the visitor, and the message effect is further improved.

Referring now to FIG. 11, shown is a schematic diagram of an electronic device suitable for use in implementing some embodiments of the present application. The electronic device shown in fig. 11 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present application.

As shown in fig. 11, the electronic device may include a controller 1101, a memory 1102, a communication interface 1103, an input unit 1104, an output unit 1105, and a communication bus 1106. Wherein the controller 1101 and the memory 1102 are connected to each other via a communication bus 1106. A communication interface 1103, an input unit 1104, and an output unit 1105 are also connected to the communication bus 1106.

The communication interface 1103 may be an interface of a communication module, such as an interface of a GSM module. The communication interface 1103 can be used to obtain data sent by other controllers, and the communication interface 1103 can also be used to send data to other components in the electronic device, such as to a display screen.

In the embodiment of the present application, the controller 1101 may be a Central Processing Unit (CPU), an application-specific integrated circuit (ASIC), a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf programmable gate array (FPGA), or other programmable logic devices.

In one possible implementation, the memory 1102 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data created during use of the computer, such as user data, user access data, audio data, and the like.

Further, the memory 1102 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device or other volatile solid-state storage device.

The controller 1101 may call a program stored in the memory 1102, and in particular, the controller 1101 may execute the data interaction method shown in any one of the embodiments of fig. 4 to 9.

The memory 1102 is used for storing one or more programs, the programs may include program codes including computer operation instructions, and in this embodiment, the memory 1102 stores at least the programs for implementing the following functions:

the outdoor controller controls the outdoor display screen to display the message guiding information; the outdoor controller responds to the message instruction to control the outdoor camera to collect the message image outside the door and control the outdoor sound pickup to collect the message sound outside the door, so as to obtain message data comprising the message image and the message sound; the outdoor controller sends the message data to the indoor controller; and the indoor controller responds to the message checking instruction, sends the message image to the indoor display screen for displaying, and sends the message sound to the indoor loudspeaker for outputting.

The present application may further include an input unit 1105, where the input unit 1105 may include at least one of a touch sensing unit that senses a touch event on the touch display panel, a keyboard, a mouse, a camera, a sound pickup, and the like.

The output unit 1104 may include: at least one of a display, a speaker, a vibration mechanism, a light, and the like. The display may comprise a display panel, such as a touch display panel or the like. In one possible case, the Display panel may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like. The vibration mechanism is operable to displace the electronic device 1100, and in one possible implementation, the vibration mechanism includes a motor and an eccentric vibrator, and the motor rotates the eccentric vibrator to generate vibration. The brightness and/or color of the lamp can be adjusted, in a possible implementation manner, different information can be embodied through at least one of the on-off, brightness and color of the lamp, for example, the alarm information can be embodied through red light emitted by the lamp.

Of course, the structure of the electronic device shown in fig. 11 does not constitute a limitation of the electronic device in the embodiment of the present application, and the electronic device may include more or less components than those shown in fig. 11 or some components in combination in practical applications.

The present application provides a computer readable medium, on which a computer program is stored, wherein the program, when executed by a controller, implements the data interaction method described in the above method embodiments.

The embodiment of the present application provides a controller, where the controller is configured to run a program, where the program implements the data interaction method described in the above method embodiments when running.

The present application further provides a computer program product, which when executed on a data processing device, causes an electronic device to implement the data interaction method described in the above method embodiments.

In addition, the electronic device, the controller, the computer readable medium, or the computer program product provided in the foregoing embodiments of the present application may all be used to execute the corresponding method provided above, and therefore, the beneficial effects achieved by the electronic device, the controller, the computer readable medium, or the computer program product may refer to the beneficial effects in the corresponding method provided above, and are not described herein again.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a controller of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the controller of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

In a typical configuration, a computing device includes one or more Controllers (CPUs), input/output interfaces, network interfaces, and memory.

The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.

Computer-readable media, which include both non-transitory and non-transitory, removable and non-removable media, may implement the information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.

As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The above description is only for the purpose of illustrating the preferred embodiments of the present application and the technical principles applied, and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. The scope of the invention according to the present application is not limited to the specific combinations of the above-described features, and may also cover other embodiments in which the above-described features or their equivalents are arbitrarily combined without departing from the spirit of the invention. For example, the above features may be replaced with (but not limited to) features having similar functions disclosed in the present application.

Claims

1. A data interaction method is applied to a data interaction device, the data interaction device comprises an outdoor device and an indoor device, the outdoor device comprises an outdoor camera, an outdoor sound pickup, an outdoor display screen and an outdoor controller, the indoor device comprises an indoor display screen, an indoor loudspeaker and an indoor controller, and the method comprises the following steps:

the outdoor controller sends the message data to the indoor controller;

2. The method of claim 1, wherein the in-door apparatus further comprises an in-door camera, the method further comprising:

the in-door controller transmits the in-door image to the out-door controller;

3. The method of claim 1, wherein the in-door apparatus further comprises an in-door camera and an in-door pickup, the method further comprising:

4. The method according to claim 3, wherein the in-door controller obtains message guidance information based on the message guidance image and the message guidance sound, including:

and/or the presence of a gas in the gas,

5. The method of claim 1, further comprising:

6. The method of claim 1, wherein the in-door controller and the out-door controller establish a communication connection using a default key and encrypt the transmitted data using the default key, the method further comprising:

the door outer controller sends the data to the door inner controller;

7. The method of claim 1, wherein the in-door controller and the out-door controller establish a communication connection using a target key and encrypt the transmitted data using the target key, the method further comprising:

8. The utility model provides a data interaction device, its characterized in that, data interaction device includes outdoor equipment and interior equipment, outdoor equipment includes the outer camera of door, the outer adapter of door, the outer display screen of door and the outer controller of door, interior equipment includes interior display screen, interior speaker and interior controller in the door, the outer controller of door includes: guide the control unit, first collection control unit and first message sending unit, the interior controller includes: a first display control unit for controlling the display of the display panel,

9. The data interaction device of claim 8, wherein the in-door apparatus further comprises an in-door camera, and the out-door controller further comprises: the identification element, look over order sending unit and second display control unit, the controller still includes in the door: a second acquisition control unit for controlling the acquisition of the image,

10. A computer-readable medium, on which a computer program is stored, wherein the program, when executed by a controller, implements the data interaction method of any one of claims 1 to 7.