CN116132607A

CN116132607A - Device control method, device, electronic device and storage medium

Info

Publication number: CN116132607A
Application number: CN202310030006.2A
Authority: CN
Inventors: 赵庭滕; 宋娟
Original assignee: Lumi United Technology Co Ltd
Current assignee: Lumi United Technology Co Ltd
Priority date: 2023-01-05
Filing date: 2023-01-05
Publication date: 2023-05-16

Abstract

The application relates to a device control method, a device, an electronic device and a storage medium. The method comprises the following steps: displaying a video picture corresponding to the selected current camera equipment in a picture display area of the current interface; switching the video picture displayed in the picture display area to a video picture corresponding to the target camera equipment in response to a switching operation triggered for the selected target camera equipment; wherein the target image pickup apparatus is an image pickup apparatus other than the current image pickup apparatus among a plurality of image pickup apparatuses. By adopting the method, the viewing efficiency of the video picture can be improved, and the occupation of screen space can be effectively reduced.

Description

Device control method, device, electronic device and storage medium

Technical Field

The application relates to the technical field of intelligent home, in particular to a device control method, a device, electronic equipment and a storage medium.

Background

In the known view manner of presenting multiple cameras, multiple video windows are directly tiled, as shown in fig. 1, however, many times, a user only needs to pay attention to a video picture of one of the cameras, so that the above manner occupies a large part of screen space, and is inconvenient or cannot use other functions. Moreover, the requirements of users for looking up a certain camera quickly cannot be met, and the viewing efficiency of video pictures is low.

Disclosure of Invention

In view of the foregoing, it is desirable to provide an apparatus control method, apparatus, electronic device, and storage medium that enable a user to quickly switch to a video frame corresponding to an image capturing apparatus that wants to view, improve viewing efficiency of the video frame, and reduce screen space occupation.

In a first aspect, an embodiment of the present application provides an apparatus control method, including:

displaying a video picture corresponding to the selected current camera equipment in a picture display area of the current interface;

switching the video picture displayed in the picture display area to a video picture corresponding to the target camera equipment in response to a switching operation triggered for the selected target camera equipment;

wherein the target image pickup apparatus is an image pickup apparatus other than the current image pickup apparatus among a plurality of image pickup apparatuses.

In a second aspect, an embodiment of the present application provides an apparatus control device, including:

the display module is used for displaying a video picture corresponding to the selected current camera equipment in a picture display area of the current interface;

the processing module is used for responding to the switching operation triggered by the target camera equipment selected, and switching the video picture displayed in the picture display area into the video picture corresponding to the target camera equipment;

In some embodiments, the screen display area displays at least one device control, and each device control corresponds to one image capturing device; the processing module is specifically configured to, in response to receiving a touch operation on a target device control in the at least one device control, obtain a switching operation triggered by a target image capturing device corresponding to the target device control.

In some embodiments, the processing module is specifically configured to determine a sliding direction of a sliding operation triggered based on the screen display area; and determining the adjacent image pickup apparatus corresponding to the sliding direction as the target image pickup apparatus corresponding to the triggered switching operation.

In some embodiments, the screen display area displays a device switch control; the processing module is specifically used for responding to the selection operation of the equipment switching control displayed in the picture display area and triggering the display module to display an equipment selection page; the apparatus selection page includes at least one image capturing apparatus other than the current image capturing apparatus; in response to a selection operation for a selected target image capturing apparatus, a switching operation triggered for the target image capturing apparatus is acquired.

In some embodiments, the apparatus further includes a detection module configured to detect whether a state of the target image capturing device meets a preset requirement; and if the state of the target image pickup equipment meets the preset requirement, triggering a processing module to switch the video image displayed in the image display area into the video image corresponding to the target image pickup equipment.

In some embodiments, the processing module is further configured to obtain a configuration operation for the image capturing device, and trigger the display module to display a device configuration page; the equipment configuration page comprises image pickup equipment in each space and/or selection controls corresponding to at least one image pickup equipment group; and acquiring added image capturing apparatuses in response to a trigger operation for each selection control, and binding each added image capturing apparatus to the screen display area.

In some embodiments, the display module is further configured to display a configuration page in response to a configuration operation triggered based on the screen display area;

the processing module is also used for receiving the triggering operation of the target operation control and adjusting the association relation between the image pickup equipment corresponding to the target operation control and the picture display area; and updating the picture display area according to the adjusted association relation.

In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a memory, and a computer program stored on the memory and executable by the processor, where the computer program when executed by the processor implements the device control method described in any embodiment of the present application.

In a fourth aspect, embodiments of the present application provide a computer readable storage medium having a computer program stored thereon, the computer program, when executed by a processor, implementing the device control method according to any embodiment of the present application.

In a fifth aspect, embodiments of the present application provide a computer readable storage medium having a computer program stored thereon, the computer program, when executed by a processor, implementing the device control method according to any embodiment of the present application.

In a sixth aspect, embodiments of the present application provide a computer program product or computer program comprising computer instructions stored in a computer readable storage medium; the processor of the computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions to implement the steps in the device control method of the embodiments of the present application.

According to the device control method, the device, the electronic device and the storage medium, after the switching operation triggered by the selected target camera device is acquired, the video picture displayed in the picture display area of the current interface is switched to the video picture corresponding to the target camera device, so that a user can quickly switch to the video picture corresponding to the camera device to be checked, the checking efficiency of the video picture is improved, the video pictures of a plurality of camera devices are not required to be displayed on a screen at the same time, and the occupation of screen space can be effectively reduced.

Drawings

FIG. 1 is a schematic diagram of a display interface of a conventional multi-camera;

FIG. 2 is an application environment diagram of a device control method in one embodiment;

FIG. 3 is a flow chart of a method of device control in one embodiment;

FIG. 4 is a diagram illustrating a video frame switch in a frame display area according to one embodiment;

FIG. 5 is a second schematic diagram of video frame switching displayed in a frame display area according to one embodiment;

FIG. 6 is a third exemplary video frame switch diagram of a frame display area display according to one embodiment;

FIG. 7 is a schematic diagram of an image pickup apparatus configuration process in one embodiment;

FIG. 8 is a schematic diagram II of an image capturing apparatus configuration process in one embodiment;

FIG. 9 is a schematic diagram of a device control interface in one embodiment;

FIG. 10 is a flow diagram of a camera group configuration in one embodiment;

FIG. 11 is a flowchart illustrating checking whether the playing status meets the requirement in one embodiment;

FIG. 12 is a block diagram of the device control apparatus in one embodiment;

fig. 13 is an internal structural diagram of an electronic device in one embodiment.

Detailed Description

In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be further described in detail with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application.

The inventor finds that the existing view mode for presenting the multiple cameras is that a plurality of video windows are directly tiled, and the mode can meet the requirement that a user can watch video pictures of the multiple cameras at the same time, but occupies most of screen space, and is inconvenient or can not use other functions. However, if these video windows are not displayed, the user cannot meet the requirement of looking at a certain camera quickly.

In view of the above problems, the inventors have studied for a long time and proposed the device control method, the device, the electronic device and the storage medium provided in the embodiments of the present application, after acquiring a switching operation triggered for a selected target image capturing device, switch a video image displayed in an image display area of a current interface to a video image corresponding to the target image capturing device, so as to enable a user to quickly switch to a video image corresponding to an image capturing device that wants to view, thereby improving the viewing efficiency of the video image, and without displaying video images of a plurality of image capturing devices on a screen at the same time, so that occupation of screen space can be effectively reduced.

Fig. 2 is a schematic view of an application environment suitable for use in embodiments of the present application. The control method provided by the embodiment of the application can be applied to an intelligent home system as shown in fig. 2, wherein the intelligent home system comprises an electronic device 1, a server 2, a plurality of camera devices 3 and a gateway 4, the electronic device 1 can communicate with the server 2 through a network, the server 2 can communicate with the gateway 4 through the network, and the camera devices 3 are accessed to the gateway 4 through a local area network. Optionally, a client capable of managing the image capturing apparatus 3 is installed in the electronic apparatus 1, where the client may be an application client (such as a mobile phone APP) or a web client, which is not limited herein. The electronic apparatus 1 may display, in a screen display area of a current interface, a video screen corresponding to a selected current image capturing apparatus, and switch the video screen displayed in the screen display area to a video screen corresponding to a selected target image capturing apparatus in response to a switching operation triggered for the target image capturing apparatus. In actual implementation, after the electronic device 1 accesses the local area network where the gateway 4 is located, the electronic device may also directly communicate with the image capturing device 3 through the local area network. The electronic device 1 may be any intelligent device with communication and storage functions, such as a smart phone, a desktop computer, a notebook computer, a tablet computer, or other intelligent communication devices with network connection functions. The image pickup apparatus 3 may be an apparatus having an image pickup function, such as a video camera, or the like.

Referring to fig. 3, an apparatus control method provided in an embodiment of the present application may be applied to an electronic apparatus having a display function, such as a mobile phone terminal, a computer terminal, a monitoring terminal, and so on. The embodiment is described by taking an example that the method is applied to the electronic device as in fig. 2, and the device control method includes the following steps:

step S101, in a screen display area of the current interface, displaying a video screen corresponding to the selected current image capturing apparatus.

After the client for managing the image pickup device is opened, the electronic device can display a current interface corresponding to the client based on user operation, and the current interface can display a picture display area which is used for displaying a video picture corresponding to the selected image pickup device. In addition, the size of the screen display area can be smaller than the size of the current interface so as to reduce the occupation of screen space as much as possible. The current image capturing device may be a default image capturing device, or may be an image capturing device selected when the client is logged out last time, or may be an image capturing device currently selected by the user.

The camera device can be installed in a living room, a bedroom, a balcony, an office and other spaces and used for collecting videos in corresponding visual angle ranges. The plurality of image pickup apparatuses may be installed in the same space or may be installed in different spaces. For example, one image pickup apparatus may be provided at each of opposite ends of the living room to collect videos of an entrance and an exit of the living room, respectively, and the like. When the electronic equipment is not connected to the local area network where the gateway is located, the video collected by the camera equipment can be sent to the electronic equipment through the server. After the electronic equipment is accessed to the local area network where the gateway is located, the video acquired by the camera equipment can also be directly sent to the electronic equipment through the gateway.

Step S103, in response to a switching operation triggered for a selected target image capturing apparatus, switching a video image displayed in the image display area to a video image corresponding to the target image capturing apparatus.

Wherein the target image capturing apparatus is an image capturing apparatus selected by a user among a plurality of image capturing apparatuses other than the current image capturing apparatus. Alternatively, a plurality of pieces of image capturing apparatus information that have been added may be displayed on the current interface of the electronic apparatus for the user to select a desired image capturing apparatus. When a user needs to switch video pictures displayed in a picture display area, namely, wants to view video pictures corresponding to target image pickup equipment, the user can input switching operation to the electronic equipment, and correspondingly, the electronic equipment responds to the switching operation triggered by the selected target image pickup equipment to switch the video pictures displayed in the picture display area into the video pictures corresponding to the target image pickup equipment so as to realize quick switching of the video pictures corresponding to different image pickup equipment. The input mode of the switching operation may be specific voice, touch control, air-separation gesture, etc., which is not limited herein. The video picture corresponding to the target image pickup device can be a video picture acquired by the target image pickup device in real time.

According to the method and the device for displaying the video images, after the switching operation triggered by the selected target image capturing equipment is obtained, the video images displayed in the image display area of the current interface are switched to the video images corresponding to the target image capturing equipment, so that a user can quickly switch to the video images corresponding to the image capturing equipment which wants to view, the viewing efficiency of the video images is improved, the video images of a plurality of image capturing equipment are not required to be displayed on a screen at the same time, and occupation of screen space can be effectively reduced.

In some embodiments, the screen display area displays at least one device control, and each device control corresponds to one image capturing device; the response to the switching operation triggered for the selected target image capturing apparatus includes: and responding to the received touch operation of a target device control in the at least one device control, and acquiring the switching operation triggered by the target camera equipment corresponding to the target device control.

The device control can be a control used for representing the device, particularly can represent the control of each camera device, and can select, switch and the like corresponding devices through the device control. The image display area is displayed with at least one equipment control, each equipment control corresponds to one image pickup equipment, and the equipment control is displayed in the image display area in a mode of operating the control, namely, each equipment control and the corresponding image pickup equipment have a configured binding relation, so that the corresponding image pickup equipment can be controlled through the equipment control. The device control can be displayed in various modes, for example, information such as the name of the image capturing device can be used as the identifier of the corresponding device control, information such as the name of the space where the image capturing device is located can be used as the identifier of the corresponding device control, and the user-defined identifier can be set. When a plurality of image capturing devices exist in a certain space, the names of the space can be combined with numbers, letters, directions or the like to respectively identify the device controls corresponding to the plurality of image capturing devices, for example, the device controls corresponding to the plurality of image capturing devices can be identified as a living room_south, a living room_north, a living room_1, a living room_2 or the like.

When the equipment controls are more and cannot be displayed in the picture display area, the space identification control can be displayed in the picture display area for a plurality of camera equipment positioned in the same space, so that when the space identification control is triggered, the equipment controls corresponding to the camera equipment positioned in the space are triggered and displayed. When the user performs operations such as clicking, double clicking, long pressing, heavy pressing and the like on the target equipment control displayed in the picture display area, the electronic equipment correspondingly receives touch operation on the target equipment control in the at least one equipment control, so that switching operation triggered by the target camera equipment corresponding to the target equipment control is obtained. Therefore, the equipment control corresponding to the image pickup equipment is displayed in the picture display area, so that a user can directly operate the equipment control to switch the image pickup equipment, and the operation flexibility and convenience are improved.

In some embodiments, the responding to the switching operation triggered for the selected target image capturing apparatus includes:

determining a sliding direction of a sliding operation in response to the sliding operation triggered based on the screen display area;

and determining the adjacent image pickup apparatus corresponding to the sliding direction as the target image pickup apparatus corresponding to the triggered switching operation.

The sliding operation includes, but is not limited to, sliding leftward (such as sliding from right to left, etc.), sliding rightward (such as sliding from left to right, etc.), sliding upward (such as sliding upward from below, etc.), sliding downward (such as sliding downward from above, etc.), and correspondingly, the sliding direction of the sliding operation includes, but is not limited to, leftward, rightward, upward, downward, etc. The electronic device may arrange all the image capturing devices in a certain order in advance, and set image capturing device selection rules corresponding to different sliding directions.

For example, when the sliding direction of the sliding operation is rightward or downward, the adjacent image pickup apparatus corresponding to the sliding direction is the next image pickup apparatus, that is, the next image pickup apparatus adjacent to the current image pickup apparatus is determined as the target image pickup apparatus, and when the sliding direction of the sliding operation is leftward or upward, the adjacent image pickup apparatus corresponding to the sliding direction is the last image pickup apparatus, that is, the last image pickup apparatus adjacent to the current image pickup apparatus is determined as the target image pickup apparatus. Taking the image capturing apparatus as a camera as an example, if the video image corresponding to the camera No. 1 is displayed in the image display area, when the rightward sliding operation is received, as shown in fig. 4 (a), the video image displayed in the image display area is switched to the video image corresponding to the camera No. 2, and, as shown in fig. 4 (b), if the leftward sliding operation is received, the video image displayed in the image display area is switched to the video image corresponding to the camera No. 1 again.

For another example, if the video frame corresponding to the camera No. 1 is displayed in the frame display area, when the upward sliding operation is received, as shown in fig. 5 (a), the video frame displayed in the frame display area is switched to the video frame corresponding to the camera No. 2, and if the downward sliding operation is received, then the video frame displayed in the frame display area is switched to the video frame corresponding to the camera No. 1. That is, the user can switch the video camera by sliding left and right, or by sliding up and down the screen display area.

In this way, by inputting the sliding operation in the screen display area, the image pickup device is switched according to the sliding operation, and the control for switching the image pickup device is not required to be displayed on the interface, so that the occupation of the screen space is further reduced, the interface is simpler, and meanwhile, the operation flexibility and convenience are improved.

In some embodiments, the screen display area displays a device switch control; the response to the switching operation triggered for the selected target image capturing apparatus includes:

responding to the selection operation of the device switching control displayed in the picture display area, and displaying a device selection page; the apparatus selection page includes at least one image capturing apparatus other than the current image capturing apparatus;

In response to a selection operation for a selected target image capturing apparatus, a switching operation triggered for the target image capturing apparatus is acquired.

When a user wants to switch a video picture displayed in a picture display area of a current interface, a selection operation, such as a space gesture operation, a touch operation and the like, of a device switching control displayed in the picture display area can be input to the electronic device, the electronic device correspondingly displays at least one image pickup device except the current image pickup device so as to enable the user to select a required target image pickup device, and after receiving the selection operation of the target image pickup device, the switching operation triggered by the target image pickup device is acquired. The device switching control can be specifically displayed in the picture display area in a mode of virtual buttons, specific identifications such as image capturing device graphics and the like.

For example, when the device switching control is displayed in the picture display area in a mode of image capturing device graphics, the electronic device may display an image capturing device list when receiving a click operation on the image capturing device graphics, so that a user may select a target image capturing device from the image capturing device list, and further switch a video picture displayed in the picture display area to a video picture corresponding to the target image capturing device.

Taking the image capturing device as an example of a camera, the switching list of the camera is aggregated in one switching button, and as shown in fig. 6 (a), a control displayed in the middle of the left side in the screen display area is the device switching control. When the user clicks the switch button, a device selection page, i.e., a camera list menu, including two image capturing devices of a camera G3 (living room) and a camera G2H (living room) is displayed above the screen display area, as shown in fig. 6 (b). The user can directly select the target camera from the camera list menu to display the video picture corresponding to the target camera in the picture display area, so that the aim of switching video sources is fulfilled. Therefore, the switching list of the camera equipment is aggregated in the equipment switching control, so that the selection interface of the camera equipment is displayed when the user triggers the equipment switching control, the selection interface of the camera equipment does not need to be displayed on the interface in real time, the occupation of screen space is further reduced, and meanwhile, the interface is simpler.

In some embodiments, before the switching the video frame displayed in the frame display area to the video frame corresponding to the target image capturing apparatus, the method further includes:

Detecting whether the state of the target camera device meets a preset requirement;

and if the state of the target image pickup device meets the preset requirement, executing the step of switching the video image displayed in the image display area to the video image corresponding to the target image pickup device.

The state of the target camera device includes but is not limited to online, non-dormant, connected, unlocked and the like. When the electronic device detects that the state of the target image pickup device meets the preset requirement, the step of switching the video image displayed in the image display area to the video image corresponding to the target image pickup device is executed when the step of normally acquiring and outputting the video image corresponding to the target image pickup device is described.

When the electronic device detects that the state of the target image pickup device does not meet the preset requirement, the electronic device indicates that the video image corresponding to the target image pickup device cannot be normally acquired and output at the moment, the state information of the target image pickup device can be output, and when the state of the target image pickup device is detected to meet the preset requirement, the step of switching the video image displayed in the image display area to the video image corresponding to the target image pickup device is executed.

In this way, when the video pictures corresponding to the image pickup equipment displayed in the picture display area are switched, the state of the image pickup equipment is judged first, and the video picture is switched when the state of the image pickup equipment meets the preset requirement, so that the smooth switching of the video pictures can be ensured, and the viewing efficiency of the video pictures is further improved. Meanwhile, necessary feedback can be given according to the state of the image pickup device, so that a user can know and clearly know the running condition of the image pickup device in time.

In some embodiments, the method further comprises:

acquiring configuration operation aiming at camera equipment, and displaying equipment configuration pages; the equipment configuration page comprises image pickup equipment in each space and/or selection controls corresponding to at least one image pickup equipment group;

in response to a trigger operation for each selection control, an added image capturing apparatus is acquired, and each added image capturing apparatus is bound to the screen display area.

After acquiring the configuration operation for the image capturing device, the electronic device may display a device configuration page for setting the binding of the image capturing device to the screen display area, where the device configuration page may include selection controls corresponding to the image capturing device and/or at least one image capturing device group in each space, for example, the device configuration page may include selection controls corresponding to the image capturing device located in a living room space of a home, and selection controls corresponding to all image capturing devices located in the home.

The user can trigger the corresponding selection control according to the requirement so as to input trigger operation to the electronic equipment, and after the electronic equipment acquires the trigger operation for each selection control, the electronic equipment determines the image pickup equipment corresponding to the triggered selection control as the added image pickup equipment and binds each added image pickup equipment to the picture display area, so that the binding of the image pickup equipment to the picture display area is completed.

Taking the image capturing device as a camera and adding the image capturing device to the image display area in a card mode, as shown in fig. 7 (a), the user may click on a "add card" button to enter a selection card interface and select the type of camera on the selection card interface, if the user currently has a plurality of cameras in the home, the camera under each room and the corresponding selection control may be displayed, and the card camera group and the corresponding selection control may be displayed at the end of the selection card page.

As shown in fig. 7 (b), after the user clicks the "ok" button, an interface effect of adding a screen display area corresponding to the selected camera can be displayed. As shown in fig. 7 (c), after the user clicks the "save" button, a screen display area corresponding to the camera added is displayed on the interface. As shown in fig. 7 (d). Therefore, the triggered image pickup equipment can be bound to the picture display area by triggering the selection control corresponding to the image pickup equipment in the equipment configuration page, so that the image pickup equipment bound to the picture display area can be flexibly and conveniently adjusted, and the user experience is improved.

In some embodiments, the method further comprises:

responding to configuration operation triggered based on the picture display area, and displaying a configuration page;

receiving triggering operation of a target operation control, and adjusting the association relation between image pickup equipment corresponding to the target operation control and the picture display area;

and updating the picture display area according to the adjusted association relation.

After acquiring a preset operation for the picture display area, for example, detecting a long press operation or a heavy press operation for the picture display area, the electronic device can output a setting interface comprising a configuration operation control, and correspondingly acquire a configuration operation triggered based on the picture display area when the configuration operation control is selected, so that a configuration page is displayed. The configuration page may include an image capturing apparatus that has been associated with the screen display area and/or an image capturing apparatus that has not been associated with the screen display area, and corresponding operation controls, such as a delete control for deleting an image capturing apparatus from the screen display area, an add control for adding an image capturing apparatus to the screen display area, and the like.

When a user needs to associate a certain image capturing device with the picture display area, an adding control corresponding to the image capturing device can be selected, so that the electronic device establishes an association relationship between the image capturing device and the picture display area, and after updating the picture display area, the user can input a switching operation to switch a video picture displayed in the picture display area to a video picture corresponding to the image capturing device. When the user does not need to continuously associate a certain image pickup device with the picture display area, a deletion control corresponding to the image pickup device can be selected, so that the electronic device deletes the association relationship between the image pickup device and the picture display area, and further the video picture corresponding to the image pickup device cannot be displayed in the picture display area.

Taking the image capturing device as a camera, as shown in fig. 8 (a), when the user presses the screen display area for a long time, the electronic device may perform vibration feedback and display a setting menu, as shown in fig. 8 (b), and after the user clicks a "configure camera" option in the setting menu, a configuration camera interface may be displayed, and the user may trigger operation controls corresponding to the added camera and the non-added camera to adjust the association relationship between the camera and the screen display area, as shown in fig. 8 (c). In this way, by triggering the operation control corresponding to the image pickup device in the configuration page, the association relation between the image pickup device and the picture display area can be adjusted, the image pickup device in the picture display area can be flexibly and conveniently updated, and the user experience is improved.

It should be understood that, although the steps in the flowchart of fig. 3 are shown in sequence as indicated by the arrows, the steps are not necessarily performed in sequence as indicated by the arrows. The steps are not strictly limited to the order of execution unless explicitly recited herein, and the steps may be executed in other orders. Moreover, at least some of the steps in fig. 3 may include multiple sub-steps or stages that are not necessarily performed at the same time, but may be performed at different times, nor do the order in which the sub-steps or stages are performed necessarily performed in sequence, but may be performed alternately or alternately with at least a portion of the sub-steps or stages of other steps or other steps.

In order to enable a more systematic understanding of the device control method provided in the embodiment of the present application, a detailed description will be given below in connection with a specific example in which the image capturing device is a video camera and the image capturing device is added to the screen display area in a card manner.

The device control method provided by the embodiment of the application mainly comprises the following steps:

first page guard with multiple cameras

1) In the home sign interface of the smart home management system, a player interface of multiple cameras can be set, and with continued reference to fig. 7, the user can select the type of camera when adding a card.

2) If there are multiple cameras under the current (family) of the user, the end of the page of the (selection card) will display the card (camera group), namely the (multiple camera card), if there are only 1 camera under the current (family) of the user, no (camera group) card will be selected.

3) When the user determines to select a camera group and saves the billboard, the corresponding function of the multi-camera card may be used.

4) All cameras in the home are configured into a multi-camera card by default, so that the user is supported to actively modify, and the specific flow is described below.

(two) presentation and interaction of multiple cameras

1) After the card is placed in the home page, the user can use the basic functions and the special mode of rapidly switching the video source of the camera. As shown in fig. 9, when full screen key (1) is clicked, a video full screen interface will be entered; for the video picture (2), different contents can be displayed according to actual conditions as a video picture display window; for the device name (3), for displaying the currently selected camera name, such as camera G3, and entering the camera device home page after clicking; clicking an operable switch play and pause state for a play/pause button (4), defaulting to a play state; clicking an operable switch mute state and a sound state for the monitoring key (5), defaulting to the mute state; for the camera list (6), configured room names such as living rooms, hallways, study rooms, balconies and the like are displayed, currently selected rooms are supported to slide left and right, and when the corresponding room name in the list is clicked, the video picture of the corresponding room can be triggered to be played. Wherein, full screen button (1) and equipment name (3) are window control, not always resident display. The multi-camera player performs the following operations in the connected state: 1) Exhaling a floating window that displays the status of the multi-camera player, such as pause/play, real-time/playback, etc.; 2) Entering a front page of a camera, wherein the front page of the camera displays the states of a multi-camera player; 3) And switching video sources, displaying in a default state, and recording the previous playing state is not needed. In addition, when the floating window is closed, all the camera cards are restored to the initial loading state.

2) Still other modes of presentation, the main difference is the switching and presentation of multiple cameras, like for example the following:

with continued reference to fig. 6, the switch list of the cameras may be aggregated in a switch button, and when the user clicks the switch button, a list menu is exhaled, which may include camera information that has been added to the card, for the user to select to switch video sources, which may have an advantage in that the space occupation of the card in the page may be further reduced.

Alternatively, with continued reference to fig. 4 and 5, the user may switch the camera by sliding the video window left and right, or up and down, which has the advantage of reducing the space occupation of the card in the page and simplifying the picture.

Method for configuring multiple cameras

1) The user can trigger the [ configure camera ] function of the card by pressing the video window for a long time, and can freely configure the camera presented under the card, so as to support the user to add, delete, sort and the like the camera, and with continued reference to fig. 8, after the user presses the video window for a long time, a setting menu comprising options of checking details, configuring the camera, editing a billboard, removing the card and the like can be displayed, if the user selects the option of configuring the camera, an interface for configuring the camera is correspondingly displayed, as shown in fig. 8 (c), and when a return/save key (1) in the interface is clicked, a floating window is exhaled; the interface further comprises card introduction information (2) for displaying the fixed images and the text, added camera information and non-added camera information for displaying the added to the card, the corresponding camera can be deleted from the card by triggering the delete control of the added camera, the corresponding camera can be added to the card by triggering the add control of the non-added camera, and the added cameras can be ordered.

2) Each billboard can be added with 1 [ camera group ], a user can configure the card under different billboards, and a single-space and single-type camera group, such as a camera group monitored in a main camera or a camera group safeguarded outside the main camera, is realized by editing cameras contained in the card.

3) All cameras in the family are configured into a multi-camera card by default, the active modification of a user is supported, and after the configuration, if the user removes a certain camera, the camera is removed from the camera group; if a user newly adds a camera, the newly added camera will not automatically enter the camera group, because this may destroy the configuration parameters edited by the user.

It will be appreciated that the multi-camera card is essentially a card array, and the array includes configured camera related data fields, including the names, IDs, icons, etc. of the cameras, and is stored in the cloud database, and the following detailed description of the camera group configuration process is provided, as shown in fig. 10, including:

step S201, a card adding instruction input by a user is acquired.

Step S202, judging whether the number of cameras in the home corresponding to the user is more than or equal to 2, if yes, executing step S203, otherwise executing step S206.

Step S203, displaying the camera group card.

Step S204, in response to the user selecting the camera group card, adding the camera group card to the billboard and saving the billboard data.

Step S205, all camera data in the home corresponding to the user are added to the camera group.

Step S206, the camera group card is not displayed.

In addition, when the user triggers playing or switching the video, the front end, namely the electronic equipment, judges the state of the camera currently selected by the user, checks whether the state of the camera meets the requirements, and if not, displays the corresponding state of the camera on the interface; and if the requirements are met, simultaneously requesting the P2P video stream at the back end to play at the interface.

The specific flow for checking whether the playing state meets the requirement is shown in fig. 11, which includes:

step S301, judging whether the electronic device is connected to the network, if yes, executing step S302, otherwise executing step S308.

Step S302, judging whether the floating window is expired, if yes, executing step S303, otherwise executing step S308.

Step S303, judging whether the camera is offline, if not, executing step S304, otherwise, executing step S308.

Step S304, judging whether the camera is locked, if not, executing step S305, otherwise executing step S308.

Step S305, judging whether the camera is dormant, if not, executing step S306, otherwise executing step S308.

Step S306, judging whether the electronic equipment is connected with the camera, if yes, executing step S307, otherwise executing step S308.

Step S307, determining that the playing state meets the requirement, and triggering to execute the playing operation.

Step S308, determining that the playing state does not meet the requirement, and outputting a corresponding state prompt.

Outputting a state prompt of the calling suspension window when the suspension window is not called; outputting an offline state prompt when the camera is in an offline state; outputting a locked state prompt when the camera is in a locked state; outputting a dormant state prompt when the camera is in a dormant state; and outputting a prompt of the unconnected state when the electronic equipment is not connected with the camera.

In the device control method provided in the above embodiment, if the electronic device with a screen has a control function and multiple cameras are bound, the multiple cameras and video frames corresponding to the currently selected camera may be displayed in a partial area of the screen of the device, and multiple camera lists may be displayed in the area, so as to support the user to quickly switch the cameras and corresponding video frames, and at the same time, other page contents may be displayed in other areas of the screen, where the user may customize the camera devices and corresponding video frames configured in the screen display. And when a plurality of cameras exist, the plurality of cameras of the user can be displayed in a smaller screen space, and the user is supported to quickly switch and play the video of the appointed camera. Thus, the following advantages are achieved: when the user triggers playing or switching, judging the playing state of the camera, giving necessary feedback according to the state, and enabling the user to know and clearly determine the running condition of the camera; the user triggers the video camera to play or switch to perform data request, and meanwhile, the P2P connection before the video camera is automatically cut off, so that the integrity of the data is ensured, and meaningless data issuing is reduced.

In one embodiment, referring to fig. 12, there is provided an apparatus control device comprising:

In some embodiments, the screen display area displays at least one device control, and each device control corresponds to one image capturing device; the processing module is specifically configured to, in response to receiving a touch operation on a target device control in the at least one device control, obtain a switching operation triggered by a target image capturing device corresponding to the target device control. Therefore, the equipment control corresponding to the image pickup equipment is displayed in the picture display area, so that a user can directly operate the equipment control to switch the image pickup equipment, and the operation flexibility and convenience are improved.

In some embodiments, the processing module is specifically configured to determine a sliding direction of a sliding operation triggered based on the screen display area; and determining the adjacent image pickup apparatus corresponding to the sliding direction as the target image pickup apparatus corresponding to the triggered switching operation. In this way, by inputting the sliding operation in the screen display area, the image pickup device is switched according to the sliding operation, and the control for switching the image pickup device is not required to be displayed on the interface, so that the occupation of the screen space is further reduced, the interface is simpler, and meanwhile, the operation flexibility and convenience are improved.

In some embodiments, the screen display area displays a device switch control; the processing module is specifically used for responding to the selection operation of the equipment switching control displayed in the picture display area and triggering the display module to display an equipment selection page; the apparatus selection page includes at least one image capturing apparatus other than the current image capturing apparatus; in response to a selection operation for a selected target image capturing apparatus, a switching operation triggered for the target image capturing apparatus is acquired. Therefore, the switching list of the camera equipment is aggregated in the equipment switching control, so that the selection interface of the camera equipment is displayed when the user triggers the equipment switching control, the selection interface of the camera equipment does not need to be displayed on the interface in real time, the occupation of screen space is further reduced, and meanwhile, the interface is simpler.

In some embodiments, the apparatus further includes a detection module configured to detect whether a state of the target image capturing device meets a preset requirement; and if the state of the target image pickup equipment meets the preset requirement, triggering a processing module to switch the video image displayed in the image display area into the video image corresponding to the target image pickup equipment. In this way, when the video pictures corresponding to the image pickup equipment displayed in the picture display area are switched, the state of the image pickup equipment is judged first, and the video picture is switched when the state of the image pickup equipment meets the preset requirement, so that the smooth switching of the video pictures can be ensured, and the viewing efficiency of the video pictures is further improved. Meanwhile, necessary feedback can be given according to the state of the image pickup device, so that a user can know and clearly know the running condition of the image pickup device in time.

In some embodiments, the processing module is further configured to obtain a configuration operation for the image capturing device, and trigger the display module to display a device configuration page; the equipment configuration page comprises image pickup equipment in each space and/or selection controls corresponding to at least one image pickup equipment group; and acquiring added image capturing apparatuses in response to a trigger operation for each selection control, and binding each added image capturing apparatus to the screen display area. Therefore, the triggered image pickup equipment can be bound to the picture display area by triggering the selection control corresponding to the image pickup equipment in the equipment configuration page, so that the image pickup equipment bound to the picture display area can be flexibly and conveniently adjusted, and the user experience is improved.

In some embodiments, the processing module is further configured to trigger the display module to display a configuration page in response to a configuration operation triggered based on the screen display area; receiving triggering operation of a target operation control, and adjusting the association relation between image pickup equipment corresponding to the target operation control and the picture display area; and updating the picture display area according to the adjusted association relation. In this way, by triggering the operation control corresponding to the image pickup device in the configuration page, the association relation between the image pickup device and the picture display area can be adjusted, the image pickup device in the picture display area can be flexibly and conveniently updated, and the user experience is improved.

The specific limitation of the device control apparatus may be referred to the limitation of the device control method hereinabove, and will not be described herein. The respective modules in the above-described device control apparatus may be implemented in whole or in part by software, hardware, and combinations thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.

In one embodiment, an electronic device is provided, the internal structure of which may be as shown in FIG. 13. The electronic device includes a processor, a memory, and a network interface connected by a system bus. Wherein the processor of the electronic device is configured to provide computing and control capabilities. The memory of the electronic device includes a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The network interface of the electronic device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a device control method.

It will be appreciated by those skilled in the art that the structure shown in fig. 13 is merely a block diagram of a portion of the structure associated with the present application and is not limiting of the electronic device to which the present application is applied, and that a particular electronic device may include more or fewer components than shown, or may combine certain components, or have a different arrangement of components.

In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, which when executed by a processor, implements the respective processes of the above-described control method embodiments, and achieves the same technical effects, and is not described herein in detail for avoiding repetition. Wherein, the computer readable storage medium is Read-only memory (ROM), random Access Memory (RAM), magnetic disk or optical disk, etc.

In one embodiment, a computer program product or computer program is provided that includes computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the steps in the above-described method embodiments.

Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the various embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.

The technical features of the above embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.

The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.

Claims

1. A method of controlling a device, the method comprising:

2. The method of claim 1, wherein the screen display area displays at least one device control, each device control corresponding to one camera device;

the response to the switching operation triggered for the selected target image capturing apparatus includes:

and responding to the received touch operation of a target device control in the at least one device control, and acquiring the switching operation triggered by the target camera equipment corresponding to the target device control.

3. The method of claim 1, wherein the responding to the triggered switching operation for the selected target image capturing apparatus comprises:

4. The method of claim 1, wherein the screen display area displays a device switch control;

5. The method according to claim 1, wherein before switching the video picture displayed in the picture display area to the video picture corresponding to the target image capturing apparatus, further comprises:

6. The method according to any one of claims 1 to 5, further comprising:

7. The method according to claims 1 to 5, characterized in that the method further comprises:

8. A device control apparatus, characterized in that the apparatus comprises:

9. An electronic device comprising a processor, a memory and a computer program stored on the memory and executable by the processor, the computer program implementing the device control method according to any one of claims 1 to 7 when executed by the processor.

10. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a computer program which, when executed by a processor, implements the device control method according to any one of claims 1 to 7.