CN117395461A

CN117395461A - Remote interaction method, device and equipment

Info

Publication number: CN117395461A
Application number: CN202311344373.6A
Authority: CN
Inventors: 尹喜; 赵允
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2023-10-17
Filing date: 2023-10-17
Publication date: 2024-01-12

Abstract

The application discloses a remote interaction method, device and equipment, and belongs to the technical field of communication. The remote interaction method comprises the following steps: receiving a first input to a first interface, wherein the first interface comprises camera identifications of at least one camera and interconnection information corresponding to each camera, and the interconnection information at least comprises equipment identifications of at least one display device pre-associated with each camera; in response to a first input, establishing a first video interaction group comprising a first electronic device, a first camera, and a first display device, the first camera being at least one of the at least one camera, the first display device being at least one of the at least one display device pre-associated with the first camera; sharing the first video picture acquired by the first electronic equipment to the first display equipment, and displaying the video picture acquired by the first camera on a display screen of the first electronic equipment.

Description

Remote interaction method, device and equipment

Technical Field

The application belongs to the technical field of communication, and particularly relates to a remote interaction method, device and equipment.

Background

With the development of network technology, intelligent devices have achieved a great deal of popularity, and users can bind electronic devices with intelligent devices to achieve remote interaction, for example, users can bind electronic devices with cameras in a certain area, so that users in the area can interact with the cameras.

In the application scene, a user of the electronic device can acquire a picture in the scene where the camera is located, but the user in the area where the camera is located cannot acquire the picture of the user on one side of the electronic device, so that the interactivity between the users is poor.

Disclosure of Invention

The embodiment of the application aims to provide a remote interaction method, device and equipment, which can solve the problem of poor interactivity of a user in the related technology when the user performs remote interaction.

In a first aspect, an embodiment of the present application provides a remote interaction method, applied to a first electronic device, where the method includes:

receiving a first input to a first interface, wherein the first interface comprises camera identifications of at least one camera and interconnection information corresponding to each camera, and the interconnection information at least comprises equipment identifications of at least one display device pre-associated with each camera;

in response to a first input, establishing a first video interaction group comprising a first electronic device, a first camera, and a first display device, the first camera being at least one of the at least one camera, the first display device being at least one of the at least one display device pre-associated with the first camera;

Sharing a first video picture acquired by the first electronic equipment to the first display equipment, and displaying a second video picture on a display screen of the first electronic equipment, wherein the second video picture is acquired by the first camera.

In a second aspect, an embodiment of the present application provides a remote interaction device, applied to a first electronic device, where the device includes:

the device comprises a receiving module, a display module and a display module, wherein the receiving module is used for receiving a first input to a first interface, the first interface comprises camera identifications of at least one camera and interconnection information corresponding to the cameras, and the interconnection information at least comprises equipment identifications of at least one display equipment pre-associated with the cameras;

a building module for building a first video interaction group including a first electronic device, a first camera, and a first display device in response to a first input, the first camera being at least one of the at least one camera, the first display device being at least one of the at least one display device pre-associated with the first camera;

the sharing module is used for sharing the first video picture acquired by the first electronic equipment to the first display equipment;

the display module is used for displaying a second video picture on the display screen of the first electronic equipment, wherein the second video picture is a video picture acquired by the first camera.

In a third aspect, embodiments of the present application provide an electronic device comprising a processor and a memory storing a program or instructions executable on the processor, the program or instructions implementing the steps of the method as described in the first aspect when executed by the processor.

In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which, when executed by a processor, implement the steps of the method as described in the first aspect.

In a fifth aspect, embodiments of the present application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being configured to execute programs or instructions to implement the steps of the method according to the first aspect.

In a sixth aspect, embodiments of the present application provide a computer program product stored in a storage medium, the program product being executed by at least one processor to implement the steps of the method as described in the first aspect.

According to the embodiment of the application, through receiving the first input of the first interface, the first interface comprises camera identifications of at least one camera and interconnection information corresponding to each camera, and the interconnection information at least comprises equipment identifications of at least one display equipment pre-associated with each camera; in response to a first input, establishing a first video interaction group comprising a first electronic device, a first camera, and a first display device, the first camera being at least one of the at least one camera, the first display device being at least one of the at least one display device pre-associated with the first camera; sharing a first video picture acquired by the first electronic equipment to the first display equipment, and displaying a second video picture on a display screen of the first electronic equipment, wherein the second video picture is acquired by the first camera. That is, the embodiment of the application fully utilizes the shooting function of the camera and the display function of the display device pre-associated with the camera, and by establishing the video interaction group comprising the first electronic device, the camera and the display device, the first video picture collected by the first electronic device can be shared to the display device, and the video picture collected by the camera can also be shared to the display screen of the first electronic device, so that the user in the scene where the camera is located and the user of the first electronic device can acquire the video picture of the other side, and the interactivity between the users is improved.

Drawings

Fig. 1 is a flowchart of a remote interaction method provided in an embodiment of the present application;

fig. 2 is a schematic diagram of a home scenario provided in an embodiment of the present application;

FIG. 3 is a schematic diagram of a first interface according to an embodiment of the present disclosure;

fig. 4 is a schematic diagram of another home scenario provided in an embodiment of the present application;

FIG. 5 is a schematic diagram of another first interface provided in an embodiment of the present application;

FIG. 6 is a schematic diagram of another first interface provided in an embodiment of the present application;

fig. 7 is a schematic diagram of a display process of a candidate access manner according to an embodiment of the present application;

FIG. 8 is a schematic diagram of another first interface provided in an embodiment of the present application;

fig. 9 is a schematic diagram of a display process of merging confirmation information according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of a remote interaction device according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of an electronic device according to an embodiment of the present application;

fig. 12 is a schematic hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

Technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

The remote interaction method, device and equipment provided by the embodiment of the application are described in detail through specific embodiments and application scenes thereof with reference to the accompanying drawings.

Fig. 1 is a flowchart of a remote interaction method provided in an embodiment of the present application, where the method may be applied to a first electronic device, and the first electronic device may be, for example, a mobile phone, a computer, a tablet, etc.

As shown in fig. 1, the remote interaction method may include the steps of:

S110, receiving a first input to the first interface.

The first interface comprises camera identifications of at least one camera and interconnection information corresponding to each camera, and the interconnection information at least comprises equipment identifications of at least one display equipment pre-associated with each camera.

And S120, responding to the first input, and establishing a first video interaction group comprising the first electronic device, the first camera and the first display device.

The first camera is at least one of the at least one camera, and the first display device is at least one of the at least one display device pre-associated with the first camera.

S130, sharing the first video picture acquired by the first electronic device to the first display device, and displaying the second video picture on a display screen of the first electronic device.

The second video picture is a video picture collected by the first camera.

The following describes the above steps in detail, as follows:

in S110, the first interface may be a display interface of a camera Application (APP). The camera APP is installed in the first electronic device in advance. For example, the first electronic device may display the first interface when receiving an operation such as clicking or touching the camera APP by the user.

The camera APP can bind with one or more cameras, that is, the first interface can display the camera identifications of one or more cameras, for example, the cameras 1, 2 and other identifications can be used to distinguish the cameras, and the camera APP can also be distinguished by other identifications.

The cameras bound to the camera APP may be located in the same scene, which may be, for example, an area consisting of one or more rooms, such as a home scene, a corporate scene, etc.

Taking a home scene as an example, each camera bound with the camera APP may be a home monitoring camera, that is, a camera with a monitoring function in a home.

The first interface may further include interconnection information corresponding to each camera, and the interconnection information may include, for example, a device identifier of at least one display device associated with each camera in advance.

In the embodiment of the application, the association relationship between the cameras and the display device can be pre-established, one camera can be pre-associated with one or more display devices in the scene, one display device can also be pre-associated with one or more cameras in the scene, and the association relationship between each camera and the display device can also be adjusted according to actual needs.

Still taking a home scenario as an example, each display device pre-associated with each camera may be located in the same area as the corresponding camera, for example, in the same room, or may be located in a different room.

Taking the example that the camera and the pre-associated display device are in the same room, the display device can display the video picture acquired by the first electronic device. Taking the example that the camera and the pre-associated display device are not in the same room, the display device can display not only the video picture collected by the first electronic device, but also the video picture collected by the associated camera.

Illustratively, each camera and each display device may be located under the same network or under different networks.

The display device may be, for example, a tablet computer, a computer display, a television, etc. The device identifier of each display device may be set as required, for example, may be distinguished by using the display device 1 and the display device 2, or may be distinguished by other manners, which is not limited in the embodiment of the present application.

The first interface may also include cameras, display devices, and a region identifier to which the user belongs, for example. Therefore, a user can conveniently select the camera and the display equipment which need to be connected.

Taking a home scene comprising three rooms, namely a living room, a bedroom and a study room as an example, it is assumed that the home scene comprises a camera, as shown in fig. 2, the camera 1, the display device 1 and the user B are located in the living room, the display device 2 and the user D are located in the bedroom, and the display device 3 and the user C are located in the study room. For example, a schematic view of the first interface may be seen in fig. 3.

Taking the example of a home scene including three rooms, namely a living room, a bedroom and a study room, it is assumed that the home scene includes two cameras, as shown in fig. 4, the camera 1, the display device 1 and the user B are located in the living room, the camera 2, the display device 2 and the user D are located in the bedroom, and the display device 3 and the user C are located in the study room. For example, a schematic view of the first interface may be seen in fig. 5.

The first input may be an input establishing a connection relationship of the first electronic device, the camera, and the display device, and illustratively the first input may include an input of a camera identification and an input of a display device identification.

Taking the application scenario shown in fig. 2 as an example, when a user needs to establish a connection between the first electronic device, the camera 1 and the display device 1, the first input may include an input to the camera 1 and an input to the display device 1, and after receiving the first input, the first electronic device may establish the connection between the first electronic device, the camera 1 and the display device 1. The first electronic device, the camera 1 and the display device 1 that establish the connection may be recorded as a video interaction group.

The first interface may further include a control for displaying a historical video interaction group, when the user clicks the control, the first electronic device may display the historical video interaction group, and the first electronic device may automatically establish connection between corresponding devices when receiving an input of the user to a certain video interaction group, which is simple and convenient. In this case, the first input may also be an input to a control displaying a historical video interaction group and an input to a certain video interaction group.

The first input may specifically be an operation such as clicking or touching a control for displaying the historical video interaction group and the corresponding video interaction group.

In S120, after receiving the first input of the user to the first interface, the first electronic device may establish connection among the first electronic device, the first camera, and the first display device, and generate a first video interaction group.

The first camera is at least one of the cameras, that is, the first electronic device can be connected with one or more cameras at the same time, and the first camera is particularly related to the number of cameras contained in a scene and the requirement of a user.

The first display device is at least one of the display devices pre-associated with the first camera, i.e. the first video interaction group may comprise one or more display devices pre-associated with the first camera.

In this embodiment of the present application, the first camera and the first display device may be located in the same room, or may be located in different rooms.

In S130, the first video frame is a video frame collected by a camera of the first electronic device, and the second video frame is a video frame collected by the first camera.

The first electronic device may share, in real time, a first video frame acquired by the self-contained camera to the first display device after the first electronic device establishes the first video interaction group of the first electronic device, the first camera, and the first display device, and at the same time, the first camera may also share, in real time, a second video frame acquired by the first camera to the first electronic device.

Taking the example that the first camera and the first display device are located in the same room, not only can the user of the first electronic device see the video picture collected by the first camera, but also the user in the room can see the video picture of the user of the first electronic device through the first display device, thereby realizing the function of bidirectional video and improving the remote interactivity among the users.

For example, taking the scenario shown in fig. 2 as an example, the first electronic device may be connected to the camera 1, where the camera 1 is connected to the display device 1, so as to implement a bidirectional video function, and the display device 2 and the display device 3 may also be connected to the camera 1, where the first video frames collected by the first electronic device may be synchronously displayed on the display device 1, the display device 2, and the display device 3.

When the user a of the first electronic device needs to make a video call with the user B of the living room, the user a may click on the first control 320 of the first area 310 in the first interface shown in fig. 3, where the first control 320 is the start identifier of the camera 1. Then click on the display device 1 to which the camera 1 is to be connected, at which time the user a and the user B can perform video interaction.

If additional selection of display devices of other rooms is required, the device identification of the display devices of other rooms may be clicked on the first interface, for example, display device 2 and display device 3 may be clicked, at which time display device 1, display device 2 and display device 3 may share the video picture of user a.

Taking the application scenario shown in fig. 4 as an example, the first electronic device may also be connected to the camera 1 and the camera 2 at the same time, where the camera 1 is connected to the display device 1, the camera 2 is connected to the display device 2, at this time, video frames collected by the camera 1 and the camera 2 may be simultaneously shared on the first electronic device, and video frames collected by the first electronic device may be synchronously presented on the display device 1 and the display device 2.

For example, the display device 1 may also be connected to the camera 2, and similarly, the display device 2 may also be connected to the camera 1, so that multi-person video interaction may be achieved, and the interaction effect is improved.

The user of the first electronic device may also select, for example, if the display device 3 is to be joined to the first video interaction group and to which camera the display device 3 is to be connected, as desired.

Taking as an example a first input comprising a first sub-input of a first start-up identification to a first camera and a second sub-input of a device identification to a first display device; illustratively, the step S120 may include the steps of:

responding to the first sub-input, and establishing first connection between the first electronic equipment and the first camera;

Responding to the second sub-input, and sending a first instruction to the first camera so that the first camera establishes a second connection between the first camera and the first display device based on the first instruction;

a first video interaction group is generated based on the first connection and the second connection.

The first actuation identifier may be in the form of a button or control or the like. The first sub-input may be an input to activate the first camera, and illustratively, the first sub-input may be a single click, double click, long press, touch, etc. operation of the first activation flag. The second sub-input may be an input to activate the first display device, and illustratively, the second sub-input may be a single click, double click, long press, etc. operation of the device identification of the first display device.

In an exemplary case, the first electronic device may establish a first connection between the first electronic device and the first camera when the first electronic device receives a first sub-input of the first start-up identifier from the user, and the first connection may be a remote connection, for example.

In an exemplary case, when the first electronic device receives the second sub-input of the device identifier of the first display device, the first electronic device may send a first instruction to the first camera, so that the first camera establishes a second connection with the first display device. Illustratively, the first instruction may include information of an address, a location, etc. of the first display device. The second connection may be a close range connection, for example.

Based on the first connection and the second connection, a first video interaction group can be generated, namely, the first camera can share the collected second video pictures to the first electronic equipment in real time, and the first electronic equipment can also share the collected first video pictures to the first display equipment in real time, so that a bidirectional video function is realized.

According to the method and the device for achieving the interaction of the video, based on the first sub-input of the first starting identification and the second sub-input of the device identification of the first display device, the first connection between the first electronic device and the first camera and the second connection between the first camera and the first display device can be established, the first video interaction group is obtained, and therefore the bidirectional video function can be achieved based on the first video interaction group, and interaction between users is improved.

In some embodiments, the first input further includes a third sub-input of a device identification for a second display device, the second display device being at least one of the at least one display device other than the first display device, the second display device not being in a same preset area as the first camera;

accordingly, after S110, the remote interaction method may further include the steps of:

Responding to the third sub-input, and sending a second instruction to the target camera so as to enable the target camera to be connected with the second display device, wherein the target camera is at least one of the first cameras;

and sharing the third video picture corresponding to the target camera to the second display device.

The second display device is a display device that is not in the same preset area as the first camera, and illustratively, the first camera is located in the living room, and the second display device may be a display device in a room other than the living room, for example, the second display device may be a display device in a bedroom and/or a study room. The second display device may have one or more.

The third sub-input may be an input that causes the second display device to join the first video interaction group, and illustratively, the third sub-input may be a single click, double click, long press, etc. operation of the second display device identification, i.e., the device identification of the second display device.

The second instruction is used for indicating that the target camera is connected with the second display device, and the second instruction may include information such as an address and a position of the target camera and the second display device.

The target camera is at least one of the first cameras. For example, the first electronic device may default to the first camera as the target camera and send the second instruction to the target camera to establish a connection between the target camera and the second display device.

The first electronic device may also select a corresponding first camera from among the first cameras as the target camera according to a user's requirement. For example, when the first electronic device receives the third sub-input of the user to the second display device, the candidate camera connectable to the second display device may be displayed, where the candidate camera may include the first camera, and the user may select the target camera from the candidate first cameras as required.

After the target camera is determined, the first electronic device can send a second instruction to the target camera, so that the target camera is connected with the second display device.

After the target camera establishes connection with the second display device, the second display device is indicated to join the first video interaction group.

The third video picture is a video picture corresponding to the target camera. Taking the first camera as the target camera as an example, for example, in a case that the first camera is one, that is, the target camera is one, the third video frame may include a first video frame collected by the first electronic device, and a second video frame collected by the first camera, that is, the second display device may share the first video frame and the second video frame.

In the case that the first camera includes two cameras, namely, the camera 1 and the camera 2, taking the connection of the second display device and the camera 1 as an example, the third video frame may include a video frame collected by the camera 1 and a video frame collected by the first electronic device, that is, the second display device may share the video frame collected by the camera 1 and the video frame collected by the first electronic device.

Taking the connection of the second display device with the camera 1 and the camera 2 as an example, the third video frame may include a video frame collected by the camera 1, a video frame collected by the camera 2, and a video frame collected by the first electronic device, that is, the second display device may share the video frame collected by the camera 1, the video frame collected by the camera 2, and the video frame collected by the first electronic device.

Because the second display device and the first camera are not in the same preset area, that is, the first camera cannot collect video pictures of the area where the second display device is located. Therefore, in the case that the second display device joins the first video interaction group, the first electronic device still only displays the second video picture acquired by the first camera, and similarly, the first display device can only display the first video picture acquired by the first electronic device.

According to the method and the device for displaying the video, on the basis of the first video interaction group, the display device which is not in the same preset area with the first camera can be accessed again, so that the display device can share the first video picture collected by the first camera and the second video picture collected by the first electronic device at the same time, interconnection sharing of a plurality of devices is achieved, and interaction among users is improved.

In practical application, there may be multiple first electronic devices, that is, the user a may perform video interaction with the user in the above-mentioned scene, and the user E may also perform video interaction with the user in the above-mentioned scene. Assuming that user E is performing video interactions with a user within the above-described scenario, for example, the first electronic device of user a may still be referred to as a first electronic device, and the first electronic device for E may be referred to as a second electronic device.

Illustratively, when the user a opens the camera APP of the first electronic device, the first interface may further include usage status information of each camera, and accordingly, the remote interaction method may further include the following steps:

receiving a second input of a target camera identification in the first interface, wherein the target camera identification is a camera identification of a target camera, and the target camera is at least one of the cameras in use;

Responding to a second input, and displaying a candidate access mode of the first electronic equipment to a second video interaction group, wherein the second video interaction group is a video interaction group comprising a target camera;

receiving a third input of a target access mode in the candidate access modes;

and responding to the third input, and displaying a fourth video picture corresponding to the target access mode on a display screen of the first electronic equipment.

The usage status information of each camera may include whether each camera is in use or not, and if so, which electronic device the camera is connected to.

For example, the first interface may further include connection state information of each display device, and the connection state information of each display device may include whether each display device is in connection.

Taking the scenario shown in fig. 2 as an example, assuming that the user E and the user B are performing a video call, that is, the second electronic device is connected to the camera 1 and the display device 1, a schematic view of the first interface may refer to fig. 6. The user a can know through fig. 6 that the user E is using the camera 1 and the display device 1.

The second start-up identifier is a start-up identifier for starting up the target camera, which is at least one camera of the cameras in use, for example, in fig. 6, and may be a start-up identifier of the camera 1. The second input may be a single click, double click, long press, touch, etc. operation of the second activation indicator.

Since user E is engaged in a video call with user B, user a may illustratively click the activation flag of camera 1 in the first interface shown in fig. 6 if user a wants to join user E with user B.

For example, as shown in fig. 7, when the first electronic device receives the second input of the start identifier of the user a to the camera 1, a candidate access manner of the first electronic device to access the second video interaction group, that is, a candidate access manner of the user a to access the user E and the user B may be displayed.

Illustratively, the candidate access manners may include, but are not limited to, accessing a video call and merely previewing a camera screen, and fig. 7 is exemplified as including both access manners.

If the user a selects an access mode of accessing the video call, the video frames of the user a and the video frames of the user E may be simultaneously shared on the display device 1, that is, the user B may simultaneously see the user a and the user E, and the video frames collected by the camera 1 and the video frames collected by the second electronic device of the user E may be displayed on the first electronic device of the user a, that is, the user a may see the user B and the user E. Thus improving the interactivity between users.

If the user a selects the access mode of previewing only the camera frame, the user a can only see the video frame collected by the camera 1, but cannot see other video frames, for example, cannot see the user E.

The target access method may be any one of candidate access methods, for example, an access method for accessing a video call in fig. 7 or an access method for previewing only a camera screen.

The third input may select an input of the target access manner, and illustratively, the third input may be a single click, touch, or the like operation of the target access manner.

For example, when the first electronic device receives the third input of the user a to the target access mode, a fourth video screen corresponding to the target access mode may be displayed on the display screen of the first electronic device.

For example, in the case where the target access manner is to access the video call, the fourth video frame may include a video frame collected by the camera 1 and a video frame collected by the second electronic device. In the case that the target access mode is to preview only the camera frame, the fourth video frame may include the video frame acquired by the camera 1.

The embodiment of the application can be suitable for a scene of single-camera multi-user access, for example, under the condition that the user E and the user B carry out video call, the user A can also access the user E and the user B, and a proper access mode can be selected according to the needs, so that the flexibility of the access mode is improved.

In some embodiments, the user E may share the video link with the user a through the second electronic device, and the user a clicks the video link to access the video call between the user E and the user B, where the video frames of the user a and the user E may be simultaneously shared on the display device 1. Of course, if the camera 1 is also connected to the display device 2 and the display device 3, the video pictures of the user a and the user E can also be shared on the display device 2 and the display device 3 at the same time.

The embodiment of the application can be applied to the scenes of single-camera single-user access, single-camera multi-user access and multi-camera single-user access, and can also be applied to the scenes of multi-camera multi-user access.

The first interface further includes a third start identifier of a fifth video frame, the fifth video frame corresponding to a third video interaction group formed by the second camera, the second electronic device, and the third display device, and a sixth video frame corresponding to a fourth video interaction group formed by the first electronic device, the third camera, and the fourth display device, the second camera and the third camera being different ones of the cameras, the third display device and the fourth display device being different ones of the display devices;

Accordingly, the remote interaction method may further include the steps of:

receiving a fourth input of a third start-up identifier;

displaying merging confirmation information of the fifth video picture and the sixth video picture in response to the fourth input;

receiving a fifth input of the merge confirmation information;

in response to the fifth input, combining the fifth video picture with the sixth video picture to obtain a target video picture;

a target video picture is displayed on a display screen of a first electronic device.

Taking the scenario shown in fig. 4 as an example, the camera 1 is located in a living room, and the camera 2 is located in a bedroom. If the user a accesses the camera 1 and the user E accesses the camera 2, the user a or the user E can combine video pictures on the first interface of the corresponding electronic device, so that two video lines are combined into one video line, namely, the first electronic device, the second electronic device, the camera 1, the camera 2 and the connected display device form a common video interaction group, and the full-member video interaction is realized.

Taking the example that the user a merges two video lines through the first interface, the fifth video frame and the sixth video frame may be video frames corresponding to different video lines, for example, the fifth video frame may be video frames corresponding to a third video interaction group formed by the second camera, the second electronic device, and the third display device, the sixth video frame may be video frames corresponding to a fourth video interaction group formed by the first electronic device, the third camera, and the fourth display device, and the second camera and the third camera are different cameras in each camera, and the third display device and the fourth display device are different display devices in each display device.

For example, the fifth video frame may be a video frame corresponding to a video interaction group formed by the camera 2, the display device 2, and the second electronic device (corresponding to the user E), and the sixth video frame may be a video frame corresponding to a video interaction group formed by the camera 1, the display device 1, and the first electronic device (corresponding to the user a).

For example, the first interface may display the sixth video, and since the first electronic device is not yet connected to the third video interaction group, the first interface only displays the start identifier of the fifth video on the first electronic device, that is, does not display the fifth video, that is, the user cannot see the fifth video.

In this case, if the user a wants to access the video call corresponding to the user E, as shown in fig. 8, the user a may click on the third start identifier 810 of the fifth video picture, and the fifth video picture and the sixth video picture may be combined through the third start identifier 810, that is, the user a may access the video call corresponding to the user E, so as to implement the full-member video call.

The fourth input may be, for example, an input to combine the fifth video frame with the sixth video frame, and the fourth input may be, for example, a click, touch, or the like operation on the third start flag.

For example, as shown in fig. 9, when the first electronic device receives the fourth input of the third start identifier from the user a, the combination confirmation information of the fifth video frame and the sixth video frame may be displayed, and the user a again confirms whether the fifth video frame and the sixth video frame need to be combined, so that the situation of misoperation of the user a may be avoided. Illustratively, combining the acknowledgement information may include both acknowledging and cancelling the information.

The fifth input may be an input by which the user confirms that the fifth video frame is combined with the sixth video frame, and may be an operation of selecting the "confirm" information, for example.

And under the condition that the first electronic device receives the operation of selecting the 'confirmation' information by the user A, combining the fifth video picture and the sixth video picture to obtain a target video picture, and displaying the target video picture on a display screen of the first electronic device. Thereby realizing the full-member video interaction.

According to the embodiment of the application, under the condition that a plurality of electronic devices are connected into different cameras, different video lines can be combined, so that combination of different video pictures is realized, and further interaction of all people is realized, and the interaction among users is improved.

In some embodiments, assuming that the second electronic device only has access to the camera 2, the first electronic device is not yet connected to any camera, at this point, if the user a can choose to access the video call of the user E or preview only the video picture of the camera 2, the operation procedure can be seen in the above embodiments.

Illustratively, user a may also choose to establish a connection with camera 1 and other available display devices, such as display device 1, for video interaction with user B.

According to the embodiment of the application, the shooting function of the camera and the display function of the display device pre-associated with the camera are fully utilized, multi-terminal sharing of video pictures is realized by establishing interconnection among different devices, and video interaction experience among users is improved.

It should be noted that, in the remote interaction method provided in the embodiments of the present application, the execution subject may be a remote interaction device, or a processing module in the remote interaction device for executing the remote interaction method. In the embodiment of the application, a remote interaction device is used as an example to execute a remote interaction method.

Fig. 10 is a schematic structural diagram of a remote interaction device according to an embodiment of the present application.

As shown in fig. 10, the remote interactive apparatus 1000 may include:

the receiving module 1001 is configured to receive a first input to a first interface, where the first interface includes a camera identifier of at least one camera and interconnection information corresponding to each camera, and the interconnection information includes at least an equipment identifier of at least one display device associated with each camera in advance;

a building module 1002, configured to, in response to a first input, build a first video interaction group including a first electronic device, a first camera, and a first display device, the first camera being at least one of the at least one camera, the first display device being at least one of the at least one display device pre-associated with the first camera;

a sharing module 1003, configured to share a first video frame acquired by the first electronic device to the first display device;

the display module 1004 is configured to display a second video frame on a display screen of the first electronic device, where the second video frame is a video frame collected by the first camera.

In some possible implementations of embodiments of the present application, the first input includes a first sub-input to the first camera and a second sub-input to the first display device;

the establishing module 1002 is specifically configured to:

in response to the second sub-input, establishing a second connection of the first camera with the first display device;

In some possible implementations of the embodiments of the present application, the first input further includes a third sub-input to a second display device, the second display device being at least one display device of the at least one display device other than the first display device, the second display device not being in a same preset area as the first camera;

the establishing module 1002 is further configured to, after the receiving module 1001 receives the first input to the first interface, establish, in response to the third sub-input, a connection between the target camera and the second display device, where the target camera is at least one of the first cameras;

the sharing module 1003 is further configured to share a third video frame corresponding to the target camera to the second display device.

In some possible implementations of the embodiments of the present application, the first interface further includes usage status information of each camera;

the receiving module 1001 is further configured to receive a second input of a target camera identifier in the first interface, where the target camera identifier is a camera identifier of the target camera, and the target camera is at least one of the cameras in use;

the display module 1004 is further configured to display, in response to a second input, a candidate access manner of the first electronic device to access a second video interaction group, where the second video interaction group is a video interaction group including a target camera;

the receiving module 1001 is further configured to receive a third input to a target access mode of the candidate access modes;

the display module 1004 is further configured to display a fourth video frame corresponding to the target access mode on a display screen of the first electronic device in response to the third input.

In some possible implementations of the embodiments of the present application, the first interface further includes a start identifier of a fifth video frame and a sixth video frame, where the fifth video frame corresponds to a third video interaction group formed by the second camera, the second electronic device, and the third display device, and the sixth video frame corresponds to a fourth video interaction group formed by the first electronic device, the third camera, and the fourth display device, where the second camera and the third camera are different cameras in each camera, and the third display device and the fourth display device are different display devices in each display device;

The receiving module 1001 is further configured to receive a fourth input of a start identifier;

the display module 1004 is further configured to display merging confirmation information of the fifth video frame and the sixth video frame in response to the fourth input;

the receiving module 1001 is further configured to receive a fifth input of merging confirmation information;

the remote interactive apparatus 1000 may further include:

the merging module is used for responding to the fifth input, merging the fifth video picture and the sixth video picture to obtain a target video picture;

the display module 1004 is further configured to display a target video frame on a display screen of the first electronic device.

The remote interaction device in the embodiment of the application may be a device, or may be a component in an electronic device, such as an integrated circuit or a chip. The electronic device may be a terminal, or may be other devices than a terminal. By way of example, the electronic device may be a mobile phone, tablet computer, notebook computer, palm computer, vehicle-mounted electronic device, mobile internet appliance (Mobile Internet Device, MID), augmented reality (augmented reality, AR)/Virtual Reality (VR) device, robot, wearable device, ultra-mobile personal computer, UMPC, netbook or personal digital assistant (personal digital assistant, PDA), etc., but may also be a server, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (TV), teller machine or self-service machine, etc., and the embodiments of the present application are not limited in particular.

The electronic device in the embodiment of the application may be an electronic device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

The remote interaction device provided in the embodiment of the present application can implement each process in the embodiments of the remote interaction methods of fig. 1 to 9, and in order to avoid repetition, a detailed description is omitted here.

As shown in fig. 11, the embodiment of the present application further provides an electronic device 1100, including a processor 1101 and a memory 1102, where the memory 1102 stores a program or instructions that can be executed on the processor 1101, and the program or instructions implement the steps of the foregoing remote interaction method embodiment when executed by the processor 1101, and achieve the same technical effects, so that repetition is avoided, and no redundant description is provided herein.

The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device.

The electronic device 1200 includes, but is not limited to: radio frequency unit 1201, network module 1202, audio output unit 1203, input unit 1204, sensor 1205, display unit 1206, user input unit 1207, interface unit 1208, memory 1209, and processor 1210.

Those skilled in the art will appreciate that the electronic device 1200 may also include a power source (e.g., a battery) for powering the various components, which may be logically connected to the processor 1210 by a power management system, such as to perform functions such as managing charging, discharging, and power consumption by the power management system. The electronic device structure shown in fig. 12 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than illustrated, or may combine certain components, or may be arranged in different components, which are not described in detail herein.

The user input unit 1207 is configured to receive a first input to a first interface, where the first interface includes a camera identifier of at least one camera and interconnection information corresponding to each camera, and the interconnection information includes at least a device identifier of at least one display device associated with each camera in advance;

a processor 1210 for establishing, in response to a first input, a first video interaction group comprising a first electronic device, a first camera, and a first display device, the first camera being at least one of the at least one cameras, the first display device being at least one of the at least one display devices pre-associated with the first camera; the method comprises the steps of,

Sharing a first video picture acquired by a first electronic device to a first display device;

the display unit 1206 is configured to display a second video frame on the display screen of the first electronic device, where the second video frame is a video frame collected by the first camera.

According to the embodiment of the application, through receiving the first input of the first interface, the first interface comprises camera identifications of at least one camera and interconnection information corresponding to each camera, and the interconnection information at least comprises equipment identifications of at least one display equipment pre-associated with each camera; in response to a first input, establishing a first video interaction group comprising a first electronic device, a first camera, and a first display device, the first camera being at least one of the at least one camera, the first display device being at least one of the at least one display device pre-associated with the first camera; sharing a first video picture acquired by the first electronic equipment to the first display equipment, and displaying a second video picture on a display screen of the first electronic equipment, wherein the second video picture is acquired by the first camera. That is, the embodiment of the application fully utilizes the shooting function of the camera and the display function of the display device pre-associated with the camera, and enables the first video picture collected by the first electronic device to be shared to the display device by establishing the video interaction group comprising the first electronic device, the camera and the display device, and the video picture collected by the camera can also be shared to the display screen of the first electronic device, so that the user in the scene where the camera is located and the user of the first electronic device can acquire the video picture of the other side, and the interactivity between the users is improved.

processor 1210 is specifically configured to:

the processor 1210 is further configured to establish, in response to the third sub-input, a connection between the target camera and the second display device after the user input unit 1207 receives the first input to the first interface, where the target camera is at least one of the first cameras; the method comprises the steps of,

the user input unit 1207 is further configured to receive a second input of a target camera identifier in the first interface, where the target camera identifier is a camera identifier of the target camera, and the target camera is at least one of the cameras in use;

the display unit 1206 is further configured to display, in response to the second input, a candidate access manner of the first electronic device to a second video interaction group, where the second video interaction group is a video interaction group including a target camera;

a user input unit 1207, configured to receive a third input of a target access mode of the candidate access modes;

the display unit 1206 is further configured to display a fourth video frame corresponding to the target access mode on a display screen of the first electronic device in response to the third input.

A user input unit 1207 for receiving a fourth input of a start-up identification;

a display unit 1206 further configured to display merging confirmation information of the fifth video picture and the sixth video picture in response to the fourth input;

a user input unit 1207 for receiving a fifth input of the merge confirmation information;

the processor 1210 is further configured to combine the fifth video frame with the sixth video frame to obtain a target video frame in response to the fifth input;

the display unit 1206 is further configured to display a target video frame on a display screen of the first electronic device.

It should be understood that in the embodiment of the present application, the input unit 1204 may include a graphics processor (Graphics Processing Unit, GPU) 12041 and a microphone 12042, and the graphics processor 12041 processes image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 1206 may include a display panel 12061, and the display panel 12061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 1207 includes at least one of a touch panel 12071 and other input devices 12072. The touch panel 12071 is also called a touch screen. The touch panel 12071 may include two parts, a touch detection device and a touch controller. Other input devices 12072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein.

Memory 1209 may be used to store software programs as well as various data. The memory 1209 may mainly include a first memory area storing programs or instructions and a second memory area storing data, wherein the first memory area may store an operating system, application programs or instructions (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, the memory 1209 may include volatile memory or nonvolatile memory, or the memory 1209 may include both volatile and nonvolatile memory. The nonvolatile Memory may be a Read-Only Memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an Electrically Erasable EPROM (EEPROM), or a flash Memory. The volatile memory may be random access memory (Random Access Memory, RAM), static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (ddr SDRAM), enhanced SDRAM (Enhanced SDRAM), synchronous DRAM (SLDRAM), and Direct RAM (DRRAM). Memory 1209 in embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.

Processor 1210 may include one or more processing units; optionally, processor 1210 integrates an application processor that primarily processes operations involving an operating system, user interface, application programs, and the like, and a modem processor that primarily processes wireless communication signals, such as a baseband processor. It will be appreciated that the modem processor described above may not be integrated into processor 1210.

The embodiment of the application further provides a readable storage medium, on which a program or an instruction is stored, which when executed by a processor, implements each process of the foregoing remote interaction method embodiment, and can achieve the same technical effects, so that repetition is avoided, and no further description is provided herein.

The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium such as a computer readable memory ROM, a random access memory RAM, a magnetic or optical disk, etc.

The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, the processor is used for running a program or instructions, each process of the remote interaction method embodiment can be realized, the same technical effect can be achieved, and in order to avoid repetition, the description is omitted here.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

The embodiments of the present application provide a computer program product stored in a storage medium, where the program product is executed by at least one processor to implement the respective processes of the remote interaction method embodiments described above, and achieve the same technical effects, and are not repeated herein.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the related art in the form of a computer software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), including several instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the method described in the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.

Claims

1. A method of remote interaction, characterized by being applied to a first electronic device, the method comprising:

receiving a first input to a first interface, wherein the first interface comprises camera identifications of at least one camera and interconnection information corresponding to each camera, and the interconnection information at least comprises equipment identifications of at least one display equipment pre-associated with each camera;

in response to the first input, establishing a first video interaction group comprising the first electronic device, a first camera and a first display device, the first camera being at least one of the at least one camera, the first display device being at least one of the at least one display device pre-associated with the first camera;

sharing a first video picture acquired by the first electronic equipment to the first display equipment, and displaying a second video picture on a display screen of the first electronic equipment, wherein the second video picture is the video picture acquired by the first camera.

2. The method of claim 1, wherein the first input comprises a first sub-input of a first activation identification for a first camera and a second sub-input of a device identification for a first display device;

The establishing, in response to the first input, a first video interaction group including the first electronic device, a first camera, and a first display device, comprising:

establishing a first connection of the first electronic device with the first camera in response to the first sub-input;

transmitting a first instruction to the first camera in response to the second sub-input, so that the first camera establishes a second connection between the first camera and the first display device based on the first instruction;

the first video interaction group is generated based on the first connection and the second connection.

3. The method of claim 1, wherein the first input comprises a third sub-input of a device identification of a second display device, the second display device being at least one of the at least one display device other than the first display device, the second display device not being in a same preset area as the first camera;

after the receiving the first input to the first interface, the method further comprises:

responding to the third sub-input, and sending a second instruction to a target camera so as to enable the target camera to establish connection with the second display device, wherein the target camera is at least one of the first cameras;

And sharing a third video picture corresponding to the target camera to the second display device.

4. The method of claim 1, wherein the first interface further comprises usage status information for each of the cameras; the method further comprises the steps of:

receiving a second input of a second starting identifier of a target camera in the first interface, wherein the target camera is at least one of the cameras in use;

responding to the second input, and displaying a candidate access mode of the first electronic equipment to access a second video interaction group, wherein the second video interaction group is a video interaction group comprising the target camera;

receiving a third input of a target access mode in the candidate access modes;

5. The method of claim 1, wherein the first interface further comprises a third initiation identification of a fifth video picture corresponding to a third video interaction group formed by a second camera, a second electronic device, and a third display device, and a sixth video picture corresponding to a fourth video interaction group formed by the first electronic device, the third camera, and a fourth display device, the second camera and the third camera being different ones of the cameras, the third display device and the fourth display device being different ones of the display devices;

The method further comprises the steps of:

receiving a fourth input of the third start-up identifier;

receiving a fifth input of the merge confirmation information;

in response to the fifth input, merging the fifth video picture with the sixth video picture to obtain a target video picture;

and displaying the target video picture on a display screen of the first electronic device.

6. A remote interaction device for application to a first electronic apparatus, the device comprising:

the device comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving a first input to a first interface, the first interface comprises camera identifications of at least one camera and interconnection information corresponding to each camera, and the interconnection information at least comprises equipment identifications of at least one display equipment pre-associated with each camera;

a building module, configured to, in response to the first input, build a first video interaction group including the first electronic device, a first camera, and a first display device, the first camera being at least one of the at least one camera, the first display device being at least one of the at least one display device pre-associated with the first camera;

the display module is used for displaying a second video picture on the display screen of the first electronic device, wherein the second video picture is a video picture acquired by the first camera.

7. The apparatus of claim 6, wherein the first input comprises a first sub-input to the first camera and a second sub-input to the first display device;

the building module is specifically configured to:

establishing a second connection of the first camera with the first display device in response to the second sub-input;

8. The apparatus of claim 6, wherein the first input further comprises a third sub-input to a second display device, the second display device being at least one of the at least one display device other than the first display device, the second display device not being in a same preset area as the first camera;

The establishing module is further configured to establish, after the receiving module receives the first input to the first interface, connection between a target camera and the second display device in response to the third sub-input, where the target camera is at least one of the first cameras;

the sharing module is further configured to share a third video frame corresponding to the target camera to the second display device.

9. The apparatus of claim 6, wherein the first interface further comprises usage status information for each of the cameras;

the receiving module is further configured to receive a second input of a target camera identifier in the first interface, where the target camera identifier is a camera identifier of a target camera, and the target camera is at least one of the cameras in use;

the display module is further configured to respond to the second input, and display a candidate access mode of the first electronic device to a second video interaction group, where the second video interaction group is a video interaction group including the target camera;

the receiving module is further configured to receive a third input of a target access mode in the candidate access modes;

And the display module is further used for responding to the third input and displaying a fourth video picture corresponding to the target access mode on a display screen of the first electronic equipment.

10. The apparatus of claim 6, wherein the first interface further comprises an activation identification of a fifth video frame corresponding to a third video interaction group formed by a second camera, a second electronic device, and a third display device, and a sixth video frame corresponding to a fourth video interaction group formed by the first electronic device, a third camera, and a fourth display device, the second camera and the third camera being different ones of the cameras, the third display device and the fourth display device being different ones of the display devices;

the receiving module is further used for receiving a fourth input of the starting identifier;

the display module is further configured to display merging confirmation information of the fifth video frame and the sixth video frame in response to the fourth input;

the receiving module is further configured to receive a fifth input of the merging confirmation information;

The apparatus further comprises:

the display module is further configured to display the target video frame on a display screen of the first electronic device.

11. An electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the method of any one of claims 1 to 5.