WO2023020197A1

WO2023020197A1 - Continuous processing method and system for multimedia content, and storage medium

Info

Publication number: WO2023020197A1
Application number: PCT/CN2022/107326
Authority: WO
Inventors: 吴俊�
Original assignee: 杭州逗酷软件科技有限公司
Priority date: 2021-08-19
Filing date: 2022-07-22
Publication date: 2023-02-23
Also published as: CN113727193A

Abstract

Disclosed in embodiments of the present application are a continuous processing method and system for multimedia content, and a storage medium, applied to the continuous processing system. The continuous processing system comprises a first terminal, a second terminal, and a camera. The method comprises: when multimedia content is processed by means of a first terminal, using a camera to perform position monitoring on a target object in a first area corresponding to the first terminal, so as to obtain first position information of the target object; if the first position information satisfies a preset switching condition, obtaining second position information of the target object by means of the camera; determining a target terminal in the at least one second terminal on the basis of the second position information and pre-stored layout information; and continuing to process the multimedia content by means of the target terminal.

Description

Multimedia content connection processing method and system, and storage medium

Cross References to Related Applications

This application claims the priority of the Chinese patent application with the application number 202110953962.9 and the application name "Multimedia content continuation processing method and system, and storage medium" submitted on August 19, 2021. The entire content of the Chinese patent application is passed References are incorporated in this application.

technical field

The present application relates to the technical field of communications, and in particular to a multimedia content connection processing method and system, and a storage medium.

Background technique

At present, common terminals such as mobile phones and TVs can cast the content they are watching to other devices based on Wi-Fi Display, Miracast and other screen projection solutions. Among them, some terminals also have multi-device interactive video connection capabilities, which can scan out other peripheral devices that support multimedia content connection, and then perform content projection.

However, in a scene where the user's position is constantly changing, the connection processing method of the multimedia content of the scene cannot timely and accurately select the device for connection processing, which has low intelligence and poor reliability.

Contents of the invention

The embodiment of the present application provides a multimedia content connection processing method and system, and a storage medium, which can ensure the successful establishment of a voice service and improve the reliability of the voice service.

The technical scheme of the embodiment of the application is realized in this way:

In the first aspect, the embodiment of the present application provides a connection processing method for multimedia content. The connection processing method for multimedia content is applied to a connection processing system, and the connection processing system includes a first terminal, a second terminal, and a camera. The methods described include:

When processing multimedia content through the first terminal, using the camera to monitor the position of the target object in the first area corresponding to the first terminal, to obtain first position information of the target object;

If the first position information satisfies a preset switching condition, obtaining second position information of the target object through the camera;

determining a target terminal among at least one of the second terminals based on the second location information and pre-stored layout information;

Processing of the multimedia content continues by the target terminal.

In the second aspect, the embodiment of the present application provides a connection processing system, the connection processing system includes: an acquisition unit, a determination unit, a processing unit,

The acquisition unit is configured to use a camera to monitor the position of the target object in the first area corresponding to the first terminal when the multimedia content is processed by the first terminal, and obtain the first position information of the target object; if If the first position information satisfies a preset switching condition, the second position information of the target object is obtained through the camera;

The determining unit is configured to determine a target terminal among at least one second terminal based on the second location information and pre-stored layout information;

The processing unit is configured to continue processing the multimedia content through the target terminal.

In a third aspect, an embodiment of the present application provides a connection processing system, the terminal device includes a processor and a memory storing instructions executable by the processor, and when the instructions are executed by the processor, the following steps are implemented: The multimedia content connection processing method described in the first aspect.

In a fourth aspect, the embodiment of the present application provides a computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the multimedia content continuation processing method as described in the first aspect is implemented.

Embodiments of the present application provide a multimedia content connection processing method, system, and storage medium, which are applied to a connection processing system. The connection processing system includes a first terminal, a second terminal, and a camera. When multimedia content is processed through the first terminal , use the camera to monitor the position of the target object in the first area corresponding to the first terminal, and obtain the first position information of the target object; if the first position information satisfies the preset switching condition, then obtain the second position of the target object through the camera information; determine a target terminal in at least one second terminal based on the second location information and pre-stored layout information; continue to process multimedia content through the target terminal. It can be seen that, in the embodiment of the present application, if the user is far away from the first terminal when the first terminal is processing multimedia content, the connection processing system can use the camera to track the position of the user, and combine the pre-stored layout information in at least one The second terminal determines the target terminal closest to the user to perform multimedia content connection processing, thereby realizing automatic connection processing of multimedia content in response to user location changes, thereby improving the intelligence and reliability of multimedia content connection processing.

Description of drawings

FIG. 1 is a schematic diagram 1 of the composition and structure of the splicing processing system proposed in the embodiment of the present application;

FIG. 2 is a second schematic diagram of the composition and structure of the splicing processing system proposed in the embodiment of the present application;

FIG. 3 is a first implementation flow diagram of a multimedia content connection processing method proposed in an embodiment of the present application;

Fig. 4 is the schematic diagram of control area;

Fig. 5 is a schematic diagram of determining location information;

FIG. 6 is a second schematic diagram of the implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application;

FIG. 7 is a schematic diagram of the third implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application;

FIG. 8 is a schematic diagram 4 of the realization flow of the multimedia content continuation processing method proposed by the embodiment of the present application;

FIG. 9 is a schematic diagram 3 of the composition and structure of the splicing processing system proposed in the embodiment of the present application;

FIG. 10 is a schematic diagram of the fifth implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application;

FIG. 11 is a schematic diagram 4 of the composition and structure of the splicing processing system proposed in the embodiment of the present application;

FIG. 12 is a fifth schematic diagram of the composition and structure of the splicing processing system proposed by the embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the specific embodiments described here are only used to explain the related application, not to limit the application. It should also be noted that, for the convenience of description, only the parts related to the relevant application are shown in the drawings.

Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the technical field to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of the present application, and are not intended to limit the present application.

In the following description, references to "some embodiments" describe a subset of all possible embodiments, but it is understood that "some embodiments" may be the same subset or a different subset of all possible embodiments, and Can be combined with each other without conflict. It should also be pointed out that the term "first\second\third" involved in the embodiment of the present application is only used to distinguish similar objects, and does not represent a specific ordering of objects. Understandably, "first\second\ The specific order or sequence of "third" can be interchanged where allowed, so that the embodiments of the application described herein can be implemented in an order other than that illustrated or described herein.

Wireless video display (Wi-Fi Display) allows users to enjoy high-quality image display effects without connecting wires. This technology can compress three-dimensional (3-dimension, 3D) video, so that -Fi) transmission. 3D video consumes a lot of bandwidth, and it will lag if it is not compressed. Wi-Fi Display technology can reduce the delay time to less than one hundredth of a millisecond.

Miracast is a wireless display standard based on Wi-Fi Direct developed by the Wi-Fi Alliance. 3C (Communication, Computer, Consumer) devices that support this standard can share video screens wirelessly. For example, mobile phones can directly transfer videos or photos to TVs or Other devices do not need any connection wires, and do not need to go through wireless hotspots (AP, Access Point).

Miracast is actually the Wi-Fi Alliance's certification name for devices that support the WiFi Display function. Miracast-certified devices can provide simplified discovery and settings, and high-speed video transmission between devices.

However, in the case of multiple devices, for example, there are TVs in multiple rooms at home, when the room is switched, the change of the position of the target object cannot be sensed, so the focus device for media projection cannot be automatically switched.

It can be seen that the current connection processing method for multimedia content cannot respond to the change of user location to continue processing multimedia content, and has low intelligence and poor reliability.

In order to solve the above problems, in the embodiment of this application, if the user is far away from the first terminal when the first terminal is processing the multimedia content, the connection processing system can use the camera to track the position of the user, and combine the pre-stored layout information at least A target terminal with the closest distance to the user is determined from a second terminal to perform multimedia content connection processing, so that automatic connection processing of multimedia content in response to user location changes can be realized, and the intelligence and reliability of multimedia content connection processing can be improved.

The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.

An embodiment of the present application provides a multimedia content connection processing method, the multimedia content connection processing method can be applied to the connection processing system, in the embodiment of the application, Figure 1 is the connection processing proposed in the embodiment of the application Schematic Diagram 1 of System Composition and Structure. As shown in FIG. 1 , a connection processing system 10 may include a first terminal 11 , a second terminal 12 and a camera 13 .

It should be noted that, in the embodiment of the present application, the first terminal 11 and the second terminal 12 may be terminal devices with multimedia content processing capabilities, such as smart phones, tablet computers, palmtop computers, mobile stations (Mobile Station, MS ), a mobile terminal (Mobile Terminal), a smart TV, etc., wherein the first terminal 11 and the second terminal 12 can communicate with one or more network devices through a wireless network.

Further, in the embodiment of the present application, the camera 13 may be composed of a plurality of different shooting devices, wherein the camera 13 may include the sensing camera set in the splicing processing system 10, and may also include the first terminal 10 and/or Or the photographing device configured by the second terminal 20 . That is, the cameras configured on the first terminal 11 and the second terminal 12 and other sensing cameras may jointly constitute the camera 13 .

Further, in the embodiment of the present application, FIG. 2 is a schematic diagram 2 of the composition and structure of the connection processing system proposed in the embodiment of the present application. As shown in FIG. 2 , the connection processing system 10 may also include a control device 14 and a cloud 15 .

It should be noted that, in the embodiment of the present application, the control device 14 may be a terminal device with a communication function, for example, the control device may be a router, a dedicated device, a smart phone, a tablet, or a computer. Wherein, the control device 14 can control the first terminal 11 , the second terminal 12 and the camera 13 , specifically, the control function of the control device 14 can be realized by installing software.

Further, in the embodiment of the present application, the control device 14 may also include the first terminal 11 or the second terminal 12 . That is to say, the first terminal 11 or the second terminal 12 can serve as a multimedia device capable of processing multimedia content, and can also serve as a processing device for performing control processing.

It should be noted that, in the embodiment of the present application, the first terminal 11, the second terminal 12, the camera 13, and the control device 14 can be bound to the cloud 15, so as to collect data and issue policies through the cloud 15. Specifically, the first terminal 11, the second terminal 12, the camera 13, and the control device 14 registered as the same account or a group of related accounts can be bound to the account in the cloud 14 by scanning two-dimensional codes, wireless pairing, and other connection methods. under.

Optionally, in the embodiment of the present application, the first terminal 11, the second terminal 12, the camera 13, and the control device 14 in the connection processing system 10 can all maintain a high-speed network connection with the cloud 15; correspondingly, the connection processing system The first terminal 11 , the second terminal 12 , and the camera 13 registered as the same account or a group of related accounts in 10 can maintain a local area network connection with the control device 14 .

That is to say, in the embodiment of the present application, the cloud 15 can communicate with the first terminal 11, the second terminal 12, the camera 13, and the control device 14 registered under any account in the connection processing system 10, and control The device 14 can only communicate with the first terminal 11 , the second terminal 12 , and the camera 13 in the connection processing system 10 registered under the same or related account as the control device 14 .

FIG. 3 is a first schematic diagram of the implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application. As shown in FIG. 3, in the embodiment of the present application, the method for the terminal device to return the voice service may include the following steps:

Step 101. When processing multimedia content through the first terminal, use the camera to monitor the position of the target object in the first area corresponding to the first terminal, and obtain first position information of the target object.

In the embodiment of the present application, when the multimedia content is processed through the first terminal, the connection processing system can use the camera to monitor the position of the target object in the first area corresponding to the first terminal, so that the first location of the target object can be obtained. location information.

It can be understood that, in the embodiment of the present application, the first terminal and the second terminal may be terminal devices provided in the connection processing system and having multimedia content processing capabilities and communication functions. For example, the first terminal may be a smart TV 1, and the second terminal may be a tablet computer, a smart TV 2, a computer, and so on.

Further, in the embodiment of the present application, the camera may be a camera configured in the splicing processing system, wherein the camera configured by the first terminal and/or the second terminal may also constitute a camera. That is, the camera configured by the first terminal, the camera configured by the second terminal, and other camera devices arranged in the corresponding control area of the splicing processing system may jointly form a camera of the splicing processing system.

That is to say, in the embodiment of the present application, the camera includes at least one of the following camera devices: the camera device configured at the first terminal, the camera device configured at the second terminal, arranged in the connection processing system corresponding to Cameras within the control area.

Optionally, in this embodiment of the present application, the control area corresponding to the connection processing system is an area determined based on the locations of all terminal devices in the connection processing system. For example, FIG. 4 is a schematic diagram of the control area. As shown in FIG. 4, the first terminal 1 in the connection processing system is set in the living room, the second terminal 1 is set in the living room, the second terminal 2 and the second terminal 3 are set in the bedroom, The second terminal 4 is set in the study, the second terminal 5 is set in the children's room, the sensing camera 1 is set in the living room, the sensing camera 2 is set in the bedroom, the sensing camera 3 is set in the study, and the sensing camera 4 is set in the children's room. Therefore, the control areas corresponding to the splicing processing system include the living room, bedroom, study room, and children's room.

It should be noted that, in the embodiment of the present application, the connection processing system can process multimedia content through the first terminal, wherein the multimedia content can be multimedia data or multimedia files in any format and form, for example, the multimedia content includes but Not limited to video, audio, pictures, documents, etc.

Further, in the embodiment of the present application, the target object may be at least one user who is currently in the first area corresponding to the first terminal. Wherein, the first area may be an area within a certain range with the first terminal as a reference point.

Correspondingly, in the embodiment of the present application, the connection processing system can use the camera to monitor the position of the target object in the first area corresponding to the first terminal, so as to obtain the first position information of the target object, and then can The first location information of the object determines the location relationship between the target object and the first terminal. It can be seen that the first location information can determine the location relationship between the target object and the first terminal.

Exemplarily, FIG. 5 is a schematic diagram of determining location information. As shown in FIG. 5, when a smart TV plays a video, the shooting device configured on the smart TV can detect users within a radius of 3 meters centered on the smart TV. A performs location monitoring to determine the location information of user A in front of the smart TV, and determines that user A is located 2 meters directly in front of the smart TV based on the location information of user A and the location of the smart TV. That is to say, in this application, when the first terminal (smart TV) is processing multimedia content (video), the camera (photographing device configured on the smart TV) can monitor the first area corresponding to the first terminal (in the form of The target object (user A) in the smart TV as the center and a radius of 3 meters) is monitored for position, so that the first position information corresponding to the target object can be determined, and the position between the target object and the first terminal can be determined. The relationship is determined (user A is located 2 meters in front of the smart TV).

It should be noted that, when determining the first location information, the camera may perform shooting processing on the target object in the first area at a first preset time interval, so that the monitoring process may be completed according to the captured image of the target object. Wherein, the first preset time interval may be set in advance by the connection processing system, for example, the first preset time interval is set to 10 seconds.

Step 102, if the first position information satisfies the preset switching condition, obtain the second position information of the target object through the camera.

In an embodiment of the present application, when the multimedia content is processed by the first terminal, the camera is used to monitor the position of the target object in the first area corresponding to the first terminal to obtain the location of the target object. After the first location information, if the first location information satisfies the preset switching condition, the subsequent processing system may obtain the second location information of the target object through the camera.

It should be noted that, in the embodiment of the present application, the preset switching condition is used to determine whether to switch the terminal processing the multimedia content. Specifically, if the preset switching condition is satisfied, the first terminal processing the multimedia content needs to be switched to another terminal.

Optionally, in the embodiments of this application. If it is determined based on the first location information that the target object has left the first area, it may be determined that the first location information satisfies the preset switching condition; if it is determined based on the first location information that the target object has not left the first area the first area, it may be determined that the first location information does not satisfy the preset switching condition.

It should be noted that, in the embodiment of the present application, when judging whether the preset switching condition is satisfied, the first terminal may directly execute the judging process, and then report the judging result to the control device and/or the cloud; The camera can directly execute the judgment process, and then report the judgment result to the control device and/or the cloud; it can also directly execute the judgment process by the control device and/or the cloud after obtaining the first location information collected by the camera.

It can be understood that, in the embodiment of the present application, after using the camera to monitor the position of the target object in the first area corresponding to the first terminal and obtaining the first position information of the target object, if Based on the first location information, it is determined that the target object has left the first area, then it can be considered that the multimedia content processed by the first terminal cannot be obtained by the target object, so it is necessary to perform switching processing on the terminal processing the multimedia content; correspondingly, if based on the first If the location information determines that the target object has not left the first area, it can be considered that the multimedia content processed by the first terminal can still be acquired by the target object, and therefore the multimedia content can continue to be processed through the first terminal.

Further, in the embodiment of the present application, if the connection processing system determines that the first position information satisfies the preset switching condition, it may continue to track the position of the target object through the camera array to obtain the first position information of the target object. 2. Location information.

It can be understood that, in this application, the second location information may be a specific location of the target object in an area other than the first area. Specifically, the second location information may be used to determine the location relationship between the target object and the second terminal. That is, the second position may be used to determine the relative positional relationship between the target object and other second terminals other than the first terminal after leaving the first area.

Optionally, when determining the second position information, the camera may perform shooting processing according to a second preset time interval, so that the tracking processing may be completed according to the image of the target object obtained through shooting. Wherein, the second preset time interval may be set in advance by the connection processing system, for example, the second preset time interval is set to 5 seconds.

It should be noted that, in the embodiment of the present application, FIG. 6 is a schematic diagram of the second implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application. As shown in FIG. 6, when the multimedia content is processed through the first terminal When using the camera to monitor the position of the target object in the first area corresponding to the first terminal, after obtaining the first position information of the target object, that is, after step 101, the connection processing system performs the connection of the multimedia content The processing method may also include the following steps:

Step 105, if the first location information satisfies the preset switching condition, determine the content parameters of the multimedia content, the characteristic information of the target object, and the identification information of the first terminal.

In an embodiment of the present application, when the multimedia content is processed by the first terminal, the camera is used to monitor the position of the target object in the first area corresponding to the first terminal to obtain the location of the target object. After the first location information, if the first location information satisfies the preset switching condition, then the connection processing system may further determine the content parameters of the multimedia content, the feature information of the target object, and the identification information of the first terminal.

Further, in the embodiment of the present application, after determining that the first location information satisfies the preset switching condition, the connection processing system may determine the content parameters of the multimedia content being processed through the first terminal. Wherein, the content parameters of the multimedia content may include at least one of the following parameters: a function type parameter, an application type parameter, a source parameter of the multimedia content, and a progress parameter of the multimedia content.

Exemplarily, in the embodiment of this application, if the multimedia content is a video, then the content parameters corresponding to the video may include video type (function type parameter), player software application identifier (application type parameter), video link (multimedia source parameter of the content), video playback progress (the progress parameter of the multimedia content), etc.

Further, in the embodiment of the present application, under the condition that the first position information meets the preset switching condition, the connection processing system may determine the characteristic information of the target object through the first terminal, or determine the target object’s characteristic information through the camera. characteristic information.

It can be understood that, in the embodiments of the present application, the feature information of the target object may represent the specific biological features of the target object. For example, the feature information of the target object may include but not limited to the target object's height features, clothing features, facial features wait.

Further, in the embodiment of the present application, the connection processing system may determine the identification information of the first terminal through the first terminal when it is determined that the first location information satisfies the preset handover condition.

It should be noted that, in the embodiment of the present application, if the first location information satisfies the preset switching condition, the connection processing system may further determine the identity information of the target object. This identity information can be used to confirm the identity of the target object, so that after the tracking image is obtained through the real-time shooting process of the camera, the identity information of the target object can be used to confirm the identity of the person in the tracking image to accurately determine Get the second location information of the target object.

Optionally, in an embodiment of the present application, when the connection processing system obtains the second position information of the target object through the camera, it may first send a tracking request to the cloud through the control device; The cloud sends a tracking instruction to the camera; then the camera can perform real-time shooting processing to obtain a tracking image; finally, the second position information can be determined according to the feature information and the tracking image.

Optionally, in this embodiment of the present application, when the connection processing system obtains the second position information of the target object through the camera, it may also directly send a tracking instruction to the camera through the control device; The camera performs real-time shooting processing to obtain a tracking image; finally, the second position information can be determined according to the characteristic information and the tracking image.

That is to say, in the embodiment of the present application, the connection processing system can control the camera through the control device, so that the camera can perform real-time shooting processing and obtain corresponding tracking images; it can also use the control device to request the cloud to perform tracking The command is issued to obtain the corresponding tracking image based on the response of the camera to the tracking command.

It should be noted that, in the embodiment of this application, after the camera receives the tracking instruction sent by the control device or the cloud, each shooting device in the camera can choose to perform real-time shooting processing within its corresponding effective area, so that Tracking images detected by each camera can be obtained.

Further, in the embodiment of the present application, when determining the second location information according to the feature information and the tracking image, the first feature information may be firstly compared with the features in the tracking image. The comparison process is to obtain a target image in the tracking image; wherein, the target image includes the target object; and then the second position information can be determined based on the target image.

That is to say, in this application, after the tracking image is obtained through the real-time shooting process of the camera, when determining the second position of the target object, the continuous processing system can combine the feature information of the target object with the person appearing in the tracking image The features of the target object are compared, so that the target image including the target object in the tracking image can be determined, and the second position information of the target object can be further determined by using the target image including the target object.

It can be understood that, in the embodiments of the present application, the pre-stored layout information may be pre-stored in the cloud and/or the control device and/or the camera and/or the first terminal and/or the second terminal; It can be synchronized to the cloud and/or the control device and/or the camera and/or the first terminal and/or the second terminal.

Correspondingly, in the embodiment of the present application, when further determining the second location information according to the feature information and the tracking image, the control device in the connection processing system may The determination of the second position information is performed; the cloud in the connection processing system may also perform the determination of the second position information according to the tracking image obtained from the camera; it may also be that the camera in the connection processing system directly according to the acquired The image is tracked to perform the determination of the second location information.

Step 103: Determine a target terminal among at least one second terminal based on the second position information and the prestored layout information.

In an embodiment of the present application, if the first position information satisfies the preset switching condition, after the connection processing system obtains the second position information of the target object through the camera, it may further base on the second position information and the pre-stored layout information A target terminal for performing splicing processing on the multimedia content is determined in at least one second terminal.

Further, in the embodiment of the present application, the pre-stored layout information may be preset by the connection processing system and represent the specific positional relationship and distance relationship between the first terminal, the second terminal, and the camera. That is to say, the layout of each device within the control area corresponding to the splicing processing system and the positional relationship between each device can be determined by pre-storing the layout information.

It can be understood that, in the embodiment of the present application, the connection processing system can first perform detection processing within the control area corresponding to the connection processing system through the camera, so that any of the first terminal, the second terminal and the camera can be determined. The relative position and distance between the two devices can finally generate the pre-stored layout information corresponding to the connection processing system.

It should be noted that, in the embodiment of the present application, the connection processing system may also receive a modification instruction from the user, and modify and update specific information in the pre-stored layout information according to the modification instruction.

Further, in the embodiment of the present application, when the connection processing system determines the target terminal among at least one second terminal based on the second position information and the pre-stored layout information, it may first base on the second position information and the The pre-stored layout information determines a distance parameter between the target object and at least one second terminal; then the second terminal corresponding to the smallest distance parameter may be determined as the target terminal.

That is to say, in this application, after the connection processing system determines at least one second location information between the target object and at least one second terminal, it can sequentially determine the target object and each of them according to the at least one second location information. The distance between the second terminals is the distance parameter between the target object and at least one second terminal. Then, a second terminal with the closest distance to the target object may be determined as the target terminal, that is, the second terminal corresponding to the minimum distance parameter is determined as the target terminal for performing connection processing on the multimedia content.

Exemplarily, in the embodiment of this application, it is assumed that there are seven second terminals set in the connection processing system, which are respectively the second terminal 1, the second terminal 2, the second terminal 3, the second terminal 4, and the second terminal 5. For the second terminal 6 and the second terminal 7, after the connection processing system determines the second position information of the target object through the characteristic information of the target object, the tracking image collected by the camera and the pre-stored layout information, the connection processing system can determine the second position information of the target object according to the second The location information determines that the four distance parameters between the target object and the second terminal 2, the second terminal 3, the second terminal 4, and the second terminal 5 are 0.51 meters, 3.3 meters, 3.5 meters, and 4 meters, respectively. Since the target object It is closest to the second terminal 2, so the connection processing system can determine the second terminal 2 as the target terminal.

It can be understood that, in the embodiment of the present application, when the target terminal is determined according to the second position information, the control device in the connection processing system may perform the determination of the target terminal, or the cloud in the connection processing system may The determination of the target terminal is performed.

Further, in the embodiment of the present application, before the connection processing system determines the target terminal among at least one second terminal based on the second location information and pre-stored layout information, it may first determine the capability parameter corresponding to the second terminal ; Wherein, the capability parameter indicates the multimedia application possessed by the second terminal.

That is to say, in the embodiment of the present application, the connection processing system may first determine the processing capability of the multimedia content supported by the second terminal. Specifically, the connection processing system may first determine the multimedia application representing the multimedia content supported by the second terminal, that is, determine the corresponding capability parameter of the second terminal.

Correspondingly, in the embodiment of the present application, when the connection processing system determines the target terminal among at least one second terminal based on the second position information and the pre-stored layout information, it may first base on the capability parameter and the Content parameters determine a candidate terminal supporting the multimedia content in at least one of the second terminals; and then determine the distance between the target object and the candidate terminal based on the second position information and the pre-stored layout information parameter; finally, the candidate terminal corresponding to the smallest distance parameter can be determined as the target terminal.

It can be understood that, in the embodiment of the present application, when the connection processing system determines the target terminal, it needs to first perform screening processing according to the capability parameters corresponding to the second terminal, and will not have the ability to continue processing the corresponding multimedia content The second terminal screened out. Specifically, for the multimedia content that needs to be connected, the second terminal that does not have a corresponding multimedia application is excluded, and the target terminal is determined only among the candidate terminals that have a multimedia application capable of supporting the multimedia content.

Step 104, continue to process the multimedia content through the target terminal.

In an embodiment of the present application, after determining a target terminal among at least one of the second terminals based on the second position information and the pre-stored layout information, the connection processing system may choose to use the target terminal according to the multimedia content The content parameter continues to process the multimedia content.

That is to say, in the embodiment of the present application, after determining that the target object has left the first area corresponding to the first terminal, the connection processing system uses the camera to determine the second location information corresponding to the target object, and according to the second location information After the target terminal closest to the target object is determined among the at least one second terminal, the multimedia content can be continued to be processed through the target terminal.

Specifically, in the embodiment of the present application, the target terminal may first acquire the content parameters of the multimedia content, and then continue to process the multimedia content according to the content parameters.

Further, in the embodiment of the present application, before the connection processing system continues to process the multimedia content according to the content parameters of the multimedia content through the target terminal, the control device may first send a handover message to the target terminal. Instruction; wherein, the switching instruction carries the content parameter.

That is to say, in the embodiment of the present application, the target terminal can receive the switch command sent by the control device, and then can obtain the content parameter of the multimedia content through the switch command, so that the connection processing of the multimedia content can be performed according to the content parameter.

Further, in the embodiment of the present application, before the connection processing system continues to process the multimedia content according to the content parameters of the multimedia content through the target terminal, it may first send the A switching instruction, so that the target terminal obtains the content parameter from the first terminal based on the switching instruction; wherein, the switching instruction carries the identification information.

That is to say, in the embodiment of the present application, the target terminal can receive the switching instruction sent by the control device, and then can obtain the identification information of the first terminal through the switching instruction, and can establish a connection with the first terminal through the identification information , and then the content parameter of the multimedia content can be acquired from the first terminal, and finally the multimedia content can be spliced according to the content parameter.

It can be understood that, in the embodiment of the present application, the switching instruction carrying content parameters or identification information can not only be sent by the control device to the target terminal, but also can be sent by the cloud to the target terminal.

Further, in the embodiment of the present application, when the connection processing system continues to process the multimedia content through the target terminal according to the content parameters of the multimedia content, if the target terminal has a multimedia application corresponding to the content parameters, Then, the connection processing system may execute the connection processing of the multimedia content through the multimedia application of the target terminal.

It can be understood that, in the embodiment of the present application, the target terminal in the connection processing system can first confirm whether it can perform connection processing according to the content parameters of the multimedia content, that is, determine whether the target terminal has the multimedia content corresponding to the connection processing Ability. Specifically, the target terminal may first determine whether it has a multimedia application capable of supporting the multimedia content based on the content parameter. If there is a corresponding multimedia application, then the multimedia application can be used to perform multimedia content connection processing according to the content parameter.

It should be noted that, in the embodiment of the present application, the connection processing system has a connection processing function for performing connection processing of multimedia content, and the connection processing system needs to start the work corresponding to the connection processing function before executing the connection processing. model.

Optionally, in this application, when the working mode corresponding to the connection processing function is turned on and the multimedia content is processed through the first terminal, the connection processing system can monitor the position of the target object through the camera.

Further, in the embodiment of the present application, FIG. 7 is a schematic diagram of the third implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application. As shown in FIG. 7 , based on the second position information and the pre-stored layout information Before determining the target terminal in at least one of the second terminals, that is, before step 103, the method for the connection processing system to perform connection processing of multimedia content may further include the following steps:

Step 106: When the multimedia content is processed by the first terminal, use the camera to monitor the second area of the second terminal, and obtain a monitoring result.

Step 107, if the monitoring result indicates that the target object in the second area satisfies the preset switching condition, obtain second position information of the target object through the camera.

In the embodiment of the present application, when the multimedia content is processed by the first terminal, the connection processing system can use the camera to monitor the second area corresponding to the first terminal, so as to obtain the monitoring result. If the monitoring result indicates that the target object in the second area satisfies the preset switching condition, then the connection processing system may obtain the second position information of the target object through the camera.

Further, in the embodiment of the present application, the target object may be at least one user who has appeared in the first area corresponding to the first terminal when the first terminal processes the multimedia content. Wherein, the first area may be an area within a certain range with the first terminal as a reference point.

It should be noted that, in the embodiment of the present application, the monitoring result obtained by the connection processing system monitoring the second area of the second terminal through the camera may be that there is a target object in the second area or that there is no target object in the second area.

Optionally, in the embodiments of this application. If the monitoring result indicates that the target object in the second area has appeared in the first area, it can be determined that the preset switching condition is met; if the monitoring result indicates that the target object in the second area has not appeared in the first area appears in an area, then it can be determined that the preset switching condition is not met.

It can be understood that, in this embodiment of the present application, when judging whether the monitoring result indicates whether the target object in the second area satisfies the preset switching condition, the connection processing system may first process the Confirm the identity of the user appearing in the first area when multimedia content is used to obtain the corresponding identity mark, and then confirm the identity of the target object appearing in the second area according to the monitoring results, and obtain the corresponding identity mark. If both IDs are the same, it may be considered that the monitoring result indicates that the target object in the second area satisfies the preset switching condition.

It can be understood that, in this embodiment of the present application, after the second location information of the target object is determined, the connection processing system may determine in at least one second terminal based on the second location information and pre-stored layout information. The target terminal that performs continuous processing on the multimedia content, and then continues to process the multimedia content through the target terminal.

It can be seen that, in the embodiment of the present application, when the first terminal is processing multimedia content, if the second terminal detects the approach of the target object, then it can confirm the identity of the approaching target object. The target is the user who is far away from the first terminal when the first terminal is processing the multimedia content, then the connection processing system can re-determine the target terminal for the connection and processing of the multimedia content in at least one second terminal, and pass the target terminal The terminal completes the connection processing of the multimedia content.

Further, in the embodiment of the present application, FIG. 8 is a schematic diagram of the fourth implementation flow of the multimedia content continuation processing method proposed in the embodiment of the present application. As shown in FIG. 8 , when the target terminal continues to process the multimedia content Before, that is, before step 104, the method for the connection processing system to perform multimedia content connection processing may also include the following steps:

Step 108: When processing multimedia content through the first terminal, if a control operation is detected through the second terminal, determine a target object corresponding to the control operation through the camera.

Step 109, if the target object satisfies the preset switching condition, determine the second terminal as the target terminal.

In an embodiment of the present application, when processing multimedia content through the first terminal, if a control operation is detected through the second terminal, the connection processing system may first determine the target object corresponding to the control operation through the camera, If the target object satisfies the preset switching condition, the connection processing system may determine the second terminal as the target terminal for performing multimedia content connection processing.

It should be noted that, in the embodiment of the present application, if the target object performing operation processing has appeared in the first area, it can be determined that the preset switching condition is met; if the target object performing operation processing has not appeared in appears in the first area, then it can be determined that the preset switching condition is not met.

It can be understood that, in the embodiment of the present application, when judging whether the target object satisfies the preset switching condition, the connection processing system may first check the The identity of the user is confirmed to obtain the corresponding identity, and then the identity of the target object corresponding to the operation process can be confirmed to obtain the corresponding identity. If the two identities are the same, the target object can be considered to meet the preset switching condition.

It should be noted that, in the embodiment of the present application, if the target object satisfies the preset switching condition, the processing device may consider that the second terminal that detects the operation process is the terminal closest to the target object, and can be used to execute the multimedia content Therefore, the second terminal can be directly determined as the target terminal, so that the target terminal can continue to process the multimedia content according to the content parameters of the multimedia content.

It can be seen that, in the embodiment of the present application, when the first terminal is processing multimedia content, if the second terminal detects the operation processing, then the connection processing system can confirm the identity of the target object corresponding to the operation processing, if If the target object is determined to be a user who is far away from the first terminal when the first terminal is processing multimedia content, then the connection processing system can directly determine the second terminal as the target terminal for continuous processing of multimedia content, and pass the target The terminal completes the connection processing of the multimedia content.

To sum up, in the embodiment of this application, the above step 101 to step 108 propose a multimedia content connection processing method, which is a capability connection solution that can be applied to smart home terminal equipment, and the connection processing system perceives the user When the user leaves a certain device in the connection processing system, the control device in the connection processing system can use the camera including multiple shooting devices to track the user's position, and can combine the representation of the room type diagram and the equipment location layout and other pre-stored layout information to determine the target terminal closest to the user, and use the target terminal to perform splicing of multimedia content.

It can be seen that the multimedia content connection processing method proposed in the embodiment of the present application can use the camera in the connection processing system in combination with the type of home and the terminal installation position to sense the change of the user's location, so as to match the switching focus terminal device. And through the connection processing method, the connection processing system can use the capability connection service to automatically connect the capability application content of different types of terminals to another device, and the whole process can be seamlessly connected even without any operation or instruction issued by the user.

An embodiment of the present application provides a multimedia content connection processing method, which is applied to a connection processing system. The connection processing system includes a first terminal, a second terminal, and a camera. When processing multimedia content through the first terminal, the camera is used to monitor the first The target object in the first area corresponding to the terminal performs position monitoring to obtain the first position information of the target object; if the first position information meets the preset switching condition, the second position information of the target object is obtained through the camera; based on the second position The information and the pre-stored layout information determine a target terminal in at least one second terminal; the multimedia content continues to be processed by the target terminal. It can be seen that, in the embodiment of the present application, if the user is far away from the first terminal when the first terminal is processing multimedia content, the connection processing system can use the camera to track the position of the user, and combine the pre-stored layout information in at least one The second terminal determines the target terminal closest to the user to perform multimedia content connection processing, thereby realizing automatic connection processing of multimedia content in response to user location changes, thereby improving the intelligence and reliability of multimedia content connection processing.

Based on the above-mentioned embodiments, another embodiment of the present application proposes a method for connection processing of multimedia content, and the method for connection processing of multimedia content can be applied in a connection processing system.

Further, in the embodiment of the present application, FIG. 9 is a schematic diagram of the third structure of the connection processing system proposed in the embodiment of the present application. As shown in FIG. 9, the connection processing system can be composed of a control device, a mobile terminal (first terminal) , a plurality of multimedia terminals (second terminal), a camera group (including at least one sensing camera), and a smart home cloud (cloud).

It should be noted that, in the embodiment of the present application, the mobile terminal and the multimedia terminal may also be configured with a camera, and may form a camera group together with the sensing camera.

Further, in the embodiment of the present application, mobile terminals, multimedia terminals, smart cameras, and control devices in the connection processing system can be bound to the user account name of the smart home cloud by scanning two-dimensional codes, wireless pairing, and other connection methods. , the mobile terminal, multimedia terminal, and camera group can maintain a high-speed network connection with the smart home cloud. Optionally, the mobile terminal, multimedia terminal, and camera group can maintain a local area network connection with the control device.

It should be noted that, in the embodiment of this application, the control device can be a router, a dedicated device or a smart device (mobile phone, tablet or computer) through the installation of software, and it can also be connected with the mobile terminal or The form of combining two multimedia terminals into one, that is, a mobile terminal or a multimedia terminal can not only be used to process multimedia content, but also can be used to perform control functions.

Optionally, in this embodiment of the application, the mobile terminal or multimedia terminal may be configured with a capability application (A1 or B1), where the capability application may be an application that presents certain capability content, such as video playback capability, audio playback capability , picture playback capability, document processing capability, etc.

Optionally, in this embodiment of the present application, the mobile terminal or multimedia terminal may be configured to be capable of connecting to a software development kit (Software Development Kit, SDK) (A2 or B2).

Specifically, in this application, A2 or B2 can register the capability identifier of A1 or B1 with the connection service, so that the capability connection service can retrieve the application capability of A1 or B1 even when A1 and B1 are not started, And determine whether the capabilities of the mobile terminal and the multimedia terminal match. For example, check whether the TV has the ability to continue the XX video on the mobile phone.

Specifically, in this application, A2 or B2 can parameterize the currently processed multimedia content, obtain corresponding content parameters (such as multimedia identification address, progress), and update the content parameters to the capability connection service (A3 or B3 ), so that the capability connection service can perform capability matching processing, that is, it can be judged whether the multimedia content processed by A1 can be connected to B1 for processing.

Optionally, in the embodiment of the present application, the mobile terminal or the multimedia terminal may be configured with a capability connection service (A3 or B3), and the capability connection service may be a resident service running on the terminal device.

Specifically, in this application, the capability continuation service can acquire the capability application currently running in the foreground of the system in real time through the capability continuation SDK.

Specifically, in this application, the capability connection service can perform capability matching and connection according to the capability connection request sent by the control device. For example, in the scenario where the multimedia content is connected from A1 to B1, the application B1 can be pulled up and the content corresponding to A1 The parameters are transmitted to B1, so that the user can watch the multimedia content played on A1 on another device through B1.

Specifically, in this application, when the focus sensing service detects that the user (target object) has left, the capability continuation service can suspend the capability presentation of the current application, parameterize the capability presentation status, and obtain corresponding content parameters (such as video Play, extract the application package name of the video, the address of the video, etc.).

Optionally, in the embodiment of the present application, the mobile terminal or multimedia terminal may be configured with a focus sensing service (A4 or B4), specifically for sensing the mobile terminal being observed or operated by the user (target object).

Specifically, in this application, the focus sensing service may call A5 or B5 to perform photo analysis in the background at regular intervals (for example, at a time interval of 5 seconds), so as to monitor whether the target object is leaving or approaching. Notifies the control device when an exit or approach event is detected.

Specifically, in this application, when the mobile terminal or the multimedia system is being operated, the capability application A1 can notify A4 through A2 that the current device has gained focus, and A4 further confirms the identity of the operator through camera photo analysis. If the identity matches the corresponding account, the control device is notified.

Optionally, in the embodiments of the present application, the mobile terminal or the multimedia terminal may be equipped with a camera analysis module (A5 or B5), which can analyze the images acquired by the camera, and use existing technologies to realize face recognition matching family membership.

Specifically, in this application, the capability connection service control notifies the start of the camera analysis module, and activates the camera analysis module to track the position of the target object. In addition to identifying the identity of the member, the camera analysis module can also identify the approaching and moving away of the target object, and turn it into an event notification to the control device.

Optionally, in the embodiment of the present application, the mobile terminal or the multimedia terminal may be configured with a camera (A6 or B6), where A6 or B6 may serve as a component of the camera group.

Optionally, in the embodiment of the present application, the mobile terminal or the multimedia terminal may be configured with an account module (A7 or B7), where the account module may connect the account of the device to the control device.

Optionally, in the embodiment of the present application, the camera group may be configured with at least one camera (C1), wherein, in addition to processing an independently configured sensing camera, it may also include a camera (A6 or B6) in a mobile terminal or a multimedia terminal. ).

Optionally, in the embodiment of the present application, the camera group can be equipped with a camera analysis module (C2), which can analyze the images acquired by the cameras, and use existing technologies to realize face recognition and match family member identities.

Optionally, in the embodiment of the present application, the camera group may be configured with a focus sensing service (C3), specifically for sensing the mobile terminal that the user (target object) is observing or operating.

Optionally, in this embodiment of the present application, the camera group may be configured with an account module (C4), where the account module may connect the account of the device to the control device.

Optionally, in this embodiment of the present application, the control device may be configured with an account module (D1), wherein the account module is used to connect all devices logged in with an account under the same family group name to the control device, establish a local area network connection, and Establish a data channel for each terminal's focus sensing service and capability extension module.

Optionally, in the embodiment of the present application, the control device may be configured with a focus analysis module (D2). The perception ability of the module calculates and matches the matching device that the user is close to and stays, and then the content of the ability application that is being played on the mobile terminal that lost focus before can be connected to the new device (target terminal) where the user moves and stays.

Optionally, in the embodiment of the present application, the control device may be configured with a device layout database (D3), wherein, the device layout record (prestored layout information) generated by online editing by the user in the cloud, the layout includes the overall and each room The name, number, room type diagram, relative coordinates of the equipment on the room type diagram, orientation, etc.

Optionally, in the embodiment of the present application, the smart home cloud may be configured with an account service (E1). This account service is used to unify the service accounts of each terminal. Each terminal can be bound through the unified account of the user, and can join the management and control of the cloud and control devices. Discover each other through the cloud. After the terminal device logs in to the bound device, it remains in a login-free state for a certain period of time, such as three months. After the terminal is powered on and connected to the network, it can synchronize its own status to the control device and the cloud.

Optionally, in the embodiment of the present application, the smart home cloud may be configured with a connection setting (E2). This continuation setting can be used to control the overall application switch of the present application, and can also configure the home room layout diagram and the position of the multimedia terminal (fixed position such as a TV set), and the position of the smart camera (fixed position) on the web page by dragging the graphic elements and tools ) and directions to generate equipment layout records (pre-stored layout information), and simultaneously synchronize the equipment layout records to the equipment layout database (D3) of the control equipment.

Optionally, in the embodiment of the present application, the smart home cloud can be configured with an event push (E3), which is mainly responsible for pushing the event status of the terminal to the control device or any terminal.

Further, in the embodiment of the present application, FIG. 10 is a schematic diagram of the fifth implementation flow of the multimedia content connection processing method proposed in the embodiment of the present application. As shown in FIG. 10 , the connection processing system performs the multimedia content connection processing method. Include the following steps:

Step 201. When a first terminal processes multimedia content, determine first location information of a target object.

In the embodiment of the present application, the first terminal perceives through the capability SDK (A2) that a capable application on the current device terminal is running in the foreground, that is, processing multimedia content, such as playing video. At this time, the capability continuation service (A3) in the first terminal is running in the background, and the capability continuation service notifies the focus sensing service (A4) to perform focus switch sensing. Next, the focus sensing service (A4) invokes the camera analysis module (A5) to monitor the position of the target object and obtain corresponding first position information.

It should be noted that, in the embodiment of the present application, assuming that the first terminal is equipped with a camera (A6), then the camera analysis module (A5) can regularly capture the first terminal according to a certain time interval (such as 5 seconds) through the camera (A6). A screen in front of the terminal to determine the first location information of the target object.

Step 202: If it is determined based on the first location information that the target object is far away from the first terminal, send a connection request to the control device.

In the embodiment of the present application, if the target object is determined to be far away from the first terminal based on the first location information, the first terminal may suspend the processing of the multimedia content and send a connection request to the control device to notify the control device to execute Follow-up processing.

It should be noted that, in the embodiment of the present application, the connection request received by the control device may carry the user identity of the target object, the leaving event, the identification information of the first terminal, and the content parameters of the multimedia content being processed. Wherein, the content parameter may include at least one of the following multiple parameters: a function type parameter indicating a large category of capabilities (such as video playback), an application type parameter indicating a small category of capabilities (such as XX video application), and a multimedia parameter indicating a capability ID. The source parameter of the content (such as a digital code to identify a specific video), and the progress parameter of the multimedia content indicating the capability parameter (such as video progress).

Step 203: In response to the connection request, the control device sends a tracking instruction to the camera group to obtain second position information of the target object.

In the embodiment of the present application, after receiving the connection request sent by the first terminal, the control device can send a tracking instruction to the camera group, so that the target object can be repositioned through the camera group, and the target object's second location can be determined. 2. Location information.

It should be noted that, in the embodiment of the present application, after receiving the leave event sent by the first terminal, the focus analysis module (D2) of the control device can send a message to the same account or a related account through the push function of the local area network or the cloud. The camera of the target object sends a notification of location tracking, wherein the camera also includes the camera (B6) configured on the second terminal.

Correspondingly, in the embodiment of the present application, after receiving the tracking instruction, the focus sensing service (C3) of the camera or the focus sensing service (B4) of the second terminal can analyze the camera ( C1, B6) The identification process of the captured tracking image is to determine whether there is a target object in the currently captured picture, and if so, determine the second position information of the target object, and report the second position information to the control terminal.

Step 204, the control device determines the target terminal according to the prestored layout information and the second location information.

In the embodiment of the present application, after the control information determines the second position information of the target object, it may further combine the pre-generated pre-stored layout information and the second position information to determine from the second terminal the link used to execute the multimedia content. The target terminal to process.

It should be noted that, in the embodiment of the present application, the pre-stored layout information in the equipment layout database (D3) of the control equipment can determine the room layout and equipment location. The control device can perform matching processing with the determined second position information of the target object according to the positional relationship and distance relationship between each camera and the second terminal recorded in the pre-stored layout information, and finally can be in at least one second terminal. Among the terminals, the terminal device with the closest distance to the target object is determined, that is, the target terminal.

Step 205, the control device sends a connection instruction to the target terminal, so that the target terminal continues to process the multimedia content.

In the embodiment of the present application, after the control device determines the target terminal closest to the target object from the second terminal, it can send a connection instruction to the target terminal, wherein the connection instruction can carry the content parameters of the multimedia content, Therefore, after receiving the connection instruction, the target terminal can continue to process the multimedia content according to the content parameters.

It should be noted that, in the embodiment of the present application, the control device notifies the target terminal closest to the target object through the data connection, and sends the content parameters of the capability application of the first terminal that lost focus to the target terminal.

Correspondingly, in the embodiment of the present application, after receiving the connection instruction, the target terminal can use the function type parameter (such as video playback) indicating a large category of capabilities in the content parameters, and the application type parameter (such as XX video application), the source parameter of the multimedia content indicating the capability ID (such as a digital code to identify a specific video), the progress parameter of the multimedia content indicating the capability parameter (such as video progress) to retrieve whether there is a registered matching capability connection in the target terminal Applications. If so, the application is launched, and the content parameters are passed to the application through the capability connection SDK, so as to perform capability connection processing (such as video playback).

Further, in the embodiment of this application, the connection processing system can simultaneously identify and track the identities and locations of different family members, such as parents and children. Suppose the parents watch movies in the living room and the children watch cartoons in the room. Switching can realize the seamless switching between the two watching programs. Children watch cartoons in the living room, and parents watch movies in the room.

It should be noted that, in the embodiment of the present application, the connection processing system can also realize buffer connection of multimedia capabilities. For example, parents write documents for a while on the computer in the room, watch movies for a while, and browse web pages, and children watch animations in the living room. The child turns off the TV in the living room, and the two exchange positions. The connection processing system can quickly continue the animation for the child in the room. After 10 minutes, the parents turn on the TV, and the TV can ask the parents which type of animation they want to continue. Multimedia processing and continued processing of documents or movies or web browsing determined by the parent's choice.

Based on the above-mentioned embodiment, in another embodiment of the present application, FIG. 11 is a schematic diagram 4 of the composition and structure of the connection processing system proposed in the embodiment of the present application. As shown in FIG. 11 , the terminal device 10 proposed in the embodiment of the present application may include An acquisition unit 16, a determination unit 17, a processing unit 18,

The acquiring unit 16 is configured to monitor the position of the target object in the first area corresponding to the first terminal by using the camera to obtain the first position information of the target object when the multimedia content is processed through the first terminal; If the first position information satisfies a preset switching condition, obtaining second position information of the target object through the camera;

The determining unit 17 is configured to determine a target terminal among at least one second terminal based on the second location information and pre-stored layout information;

The processing unit 18 is configured to continue processing the multimedia content through the target terminal.

In the embodiment of the present application, further, FIG. 12 is a schematic diagram of the fifth composition structure of the connection processing system proposed in the embodiment of the present application. As shown in FIG. 12 , the terminal device 10 proposed in the embodiment of the present application may also include a processor 19 , a memory 110 storing instructions executable by the processor 19 , further, the terminal device 10 may further include a communication interface 111 , and a bus 112 for connecting the processor 19 , the memory 110 and the communication interface 111 .

In the embodiment of the present application, the above-mentioned processor 19 may be an application specific integrated circuit (Application Specific Integrated Circuit, ASIC), a digital signal processor (Digital Signal Processor, DSP), a digital signal processing device (Digital Signal Processing Device, DSPD ), Programmable Logic Device (ProgRAMmable Logic Device, PLD), Field Programmable Gate Array (Field ProgRAMmable Gate Array, FPGA), Central Processing Unit (Central Processing Unit, CPU), controller, microcontroller, microprocessor at least one of . It can be understood that, for different devices, the electronic device used to implement the above processor function may also be other, which is not specifically limited in this embodiment of the present application. The terminal device 10 may also include a memory 110, which may be connected to the processor 19, wherein the memory 110 is used to store executable program codes, the program codes include computer operation instructions, and the memory 110 may include a high-speed RAM memory, and may also include Includes non-volatile memory, eg, at least two disk memories.

In the embodiment of the present application, the bus 112 is used to connect the communication interface 111 , the processor 19 and the memory 110 and communicate with each other among these devices.

In the embodiment of the present application, the memory 110 is used to store instructions and data.

Further, in the embodiment of the present application, the above-mentioned processor 19 is configured to, when the multimedia content is processed by the first terminal, use the camera to monitor the target object in the first area corresponding to the first terminal. Position monitoring, obtaining first position information of the target object; if the first position information satisfies a preset switching condition, obtaining second position information of the target object through the camera; based on the second position information and pre-stored layout information to determine a target terminal in at least one of the second terminals; continue to process the multimedia content through the target terminal.

In practical applications, the above-mentioned memory 110 can be a volatile memory (volatile memory), such as a random access memory (Random-Access Memory, RAM); or a non-volatile memory (non-volatile memory), such as a read-only memory (Read-Only Memory, ROM), flash memory (flash memory), hard disk (Hard Disk Drive, HDD) or solid state disk (Solid-State Drive, SSD); Provide instructions and data.

In addition, each functional module in this embodiment may be integrated into one processing unit, each unit may exist separately physically, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software function modules.

If the integrated unit is implemented in the form of a software function module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or The part contributed by the prior art or the whole or part of the technical solution can be embodied in the form of software products, the computer software products are stored in a storage medium, and include several instructions to make a computer device (which can be a personal A computer, a server, or a network device, etc.) or a processor (processor) executes all or part of the steps of the method of this embodiment. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (Read Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other various media that can store program codes.

An embodiment of the present application provides a connection processing system. The connection processing system includes a first terminal, a second terminal, and a camera. The object performs position monitoring to obtain the first position information of the target object; if the first position information meets the preset switching condition, the second position information of the target object is obtained through the camera; based on the second position information and pre-stored layout information in at least one first position information The target terminal is determined among the two terminals; and the multimedia content is continued to be processed through the target terminal. It can be seen that, in the embodiment of the present application, if the user is far away from the first terminal when the first terminal is processing multimedia content, the connection processing system can use the camera to track the position of the user, and combine the pre-stored layout information in at least one The second terminal determines the target terminal closest to the user to perform multimedia content connection processing, thereby realizing automatic connection processing of multimedia content in response to user location changes, thereby improving the intelligence and reliability of multimedia content connection processing.

An embodiment of the present application provides a computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the above-mentioned multimedia content continuation processing method is implemented.

Specifically, the program instructions corresponding to a multimedia content connection processing method in this embodiment can be stored on a storage medium such as an optical disc, a hard disk, or a USB flash drive. When the storage medium is related to a multimedia content connection processing method When the corresponding program instructions are read or executed by an electronic device, the following steps are included:

Processing of the multimedia content continues by the target terminal.

Those skilled in the art should understand that the embodiments of the present application may be provided as methods, systems, or computer program products. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) having computer-usable program code embodied therein.

The present application is described with reference to the implementation flow diagrams and/or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and/or block in the schematic flowchart and/or block diagram, and a combination of processes and/or blocks in the schematic flowchart and/or block diagram can be realized by computer program instructions. These computer program instructions may be provided to a general purpose computer, special purpose computer, embedded processor, or processor of other programmable data processing equipment to produce a machine such that the instructions executed by the processor of the computer or other programmable data processing equipment produce a Means for realizing the functions specified in one or more steps of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing apparatus to operate in a specific manner, such that the instructions stored in the computer-readable memory produce an article of manufacture comprising instruction means, the instructions The device realizes the function specified in implementing one or more procedures of the flowchart and/or one or more blocks of the block diagram.

These computer program instructions can also be loaded onto a computer or other programmable data processing device, causing a series of operational steps to be performed on the computer or other programmable device to produce a computer-implemented process, thereby The instructions provide steps for implementing the functions specified in implementing the process flow or processes of the flowchart diagrams and/or the block or blocks of the block diagrams.

The above descriptions are only preferred embodiments of the present application, and are not intended to limit the protection scope of the present application.

Industrial Applicability

Embodiments of the present application provide a multimedia content connection processing method, system, and storage medium, which are applied to a connection processing system. The connection processing system includes a first terminal, a second terminal, and a camera. When multimedia content is processed through the first terminal , use the camera to monitor the position of the target object in the first area corresponding to the first terminal, and obtain the first position information of the target object; if the first position information satisfies the preset switching condition, obtain the second position of the target object through the camera information; determine a target terminal in at least one second terminal based on the second location information and pre-stored layout information; continue to process multimedia content through the target terminal. It can be seen that, in the embodiment of the present application, if the user is far away from the first terminal when the first terminal is processing multimedia content, the connection processing system can use the camera to track the position of the user, and combine the pre-stored layout information in at least one The second terminal determines the target terminal closest to the user to perform multimedia content connection processing, thereby realizing automatic connection processing of multimedia content in response to user location changes, thereby improving the intelligence and reliability of multimedia content connection processing.

Claims

A connection processing method for multimedia content, the connection processing method for multimedia content is applied to a connection processing system, the connection processing system includes a first terminal, a second terminal, and a camera, and the method includes:

When processing multimedia content through the first terminal, using the camera to monitor the position of the target object in the first area corresponding to the first terminal, to obtain first position information of the target object;

If the first position information satisfies a preset switching condition, obtaining second position information of the target object through the camera;

determining a target terminal among at least one of the second terminals based on the second location information and pre-stored layout information;

Processing of the multimedia content continues by the target terminal.
The method according to claim 1, wherein the connection processing system further includes: a control device and a cloud; wherein the control device includes the first terminal or the second terminal.
The method according to claim 2, wherein the method further comprises:

If the first location information satisfies a preset switching condition, then determining content parameters of the multimedia content, feature information of the target object, and identification information of the first terminal.
The method according to claim 3, wherein said obtaining the second position information of the target object through the camera comprises:

sending a tracking request to the cloud through the control device;

sending a tracking instruction to the camera through the cloud;

performing real-time shooting processing through the camera to obtain a tracking image;

The second location information is determined according to the feature information and the tracking image.
The method according to claim 3, wherein said obtaining the second position information of the target object through the camera comprises:

sending a tracking instruction to the camera through the control device;

performing real-time shooting processing through the camera to obtain a tracking image;

The second location information is determined according to the feature information and the tracking image.
The method according to claim 4 or 5, wherein said determining said second location information according to said characteristic information and said tracking image comprises:

comparing the first feature information with features in the tracking image to obtain a target image in the tracking image; wherein the target image includes the target object;

The second location information is determined based on the target image.
The method according to claim 4 or 5, wherein,

The camera includes at least one of the following camera devices: a camera device configured at the first terminal, a camera device configured at the second terminal, and a camera device arranged within a control area corresponding to the connection processing system.
The method according to claim 7, wherein the method further comprises:

The pre-stored layout information is generated by the camera performing detection processing within the control area.
The method according to claim 1, wherein said determining a target terminal among at least one second terminal based on said second position information and pre-stored layout information comprises:

determining a distance parameter between the target object and at least one second terminal based on the second position information and the pre-stored layout information;

Determining the second terminal corresponding to the smallest distance parameter as the target terminal.
The method according to claim 1, wherein, before determining a target terminal among at least one of the second terminals based on the second location information and pre-stored layout information, the method further comprises:

determining a capability parameter corresponding to the second terminal; wherein the capability parameter indicates a multimedia application possessed by the second terminal;

Correspondingly, the determining the target terminal in at least one of the second terminals based on the second position information and the pre-stored layout information includes:

determining a candidate terminal supporting the multimedia content among at least one of the second terminals according to the capability parameter and the content parameter;

determining a distance parameter between the target object and the candidate terminal based on the second position information and the pre-stored layout information;

The candidate terminal corresponding to the smallest distance parameter is determined as the target terminal.
The method according to claim 2, wherein said continuing to process said multimedia content through said target terminal comprises:

Sending a switching instruction to the target terminal through the control device; wherein, the switching instruction carries the content parameter; or,

Sending a switching instruction to the target terminal by the control device, so that the target terminal acquires the content parameter from the first terminal based on the switching instruction; wherein the switching instruction carries the identification information.
The method according to claim 1, wherein said continuing to process said multimedia content through said target terminal comprises:

If the target terminal has a multimedia application corresponding to the content parameter, the multimedia application of the target terminal executes the connection process of the multimedia content.
The method according to claim 10, wherein the content parameters include at least one of the following parameters: a function type parameter, an application type parameter, a source parameter of the multimedia content, and a progress parameter of the multimedia content.
The method according to claim 1, wherein the method further comprises:

If it is determined based on the first location information that the target object has left the first area, then determining that the first location information satisfies the preset switching condition;

If it is determined based on the first location information that the target object has not left the first area, it is determined that the first location information does not satisfy the preset switching condition.
The method according to claim 2, wherein, before determining a target terminal among at least one of the second terminals based on the second location information and pre-stored layout information, the method further comprises:

When processing the multimedia content through the first terminal, using the camera to monitor the second area of the second terminal to obtain a monitoring result;

If the monitoring result indicates that the target object in the second area satisfies the preset switching condition, the second position information of the target object is obtained through the camera.
The method according to claim 2, wherein, before continuing to process the multimedia content through the target terminal, the method further comprises:

When processing the multimedia content through the first terminal, if a control operation is detected through the second terminal, determine a target object corresponding to the control operation through the camera;

If the target object satisfies the preset switching condition, determine the second terminal as the target terminal.
A connection processing system, the connection processing system comprising: an acquisition unit, a determination unit, a processing unit,

The acquisition unit is configured to use a camera to monitor the position of the target object in the first area corresponding to the first terminal when the multimedia content is processed by the first terminal, and obtain the first position information of the target object; if If the first position information satisfies a preset switching condition, the second position information of the target object is obtained through the camera;

The determining unit is configured to determine a target terminal among at least one second terminal based on the second location information and pre-stored layout information;

The processing unit is configured to continue processing the multimedia content through the target terminal.
A continuous processing system, the continuous processing system includes a processor and a memory storing instructions executable by the processor, and when the instructions are executed by the processor, the system according to any one of claims 1-16 is implemented. described method.
A computer-readable storage medium, on which a program is stored, and when the program is executed by a processor, the method according to any one of claims 1-16 is realized.