CN110177238B

CN110177238B - Image shooting method in video call process and wearable device

Info

Publication number: CN110177238B
Application number: CN201811353623.1A
Authority: CN
Inventors: 施锐彬
Original assignee: Guangdong Genius Technology Co Ltd
Current assignee: Guangdong Genius Technology Co Ltd
Priority date: 2018-11-14
Filing date: 2018-11-14
Publication date: 2021-01-26
Anticipated expiration: 2038-11-14
Also published as: CN110177238A

Abstract

The embodiment of the invention relates to the technical field of wearable equipment, and discloses an image shooting method in a video call process and wearable equipment, wherein the method comprises the following steps: the intelligent host detects whether an instruction for starting a second shooting module to shoot images is received or not in the process of video call; if so, judging whether the interval duration between the current time point and the time point of shooting the next frame of video image by the first shooting module is greater than a preset threshold value or not; if the interval duration is larger than the preset threshold value, the interval duration is utilized to control the rotatable reflector and the rotatable pentaprism to rotate to the preset angle, and then the second shooting module is controlled to shoot images and send the shot images to the video terminal. By implementing the method, the picture can be shot and shared on the premise of not stopping the video call, and the use experience of the user is improved.

Description

Image shooting method in video call process and wearable device

Technical Field

The invention relates to the technical field of wearable equipment, in particular to an image shooting method in a video call process and wearable equipment.

Background

At present, when a user carries out a video call by using a wearable device (for example, a smart watch or the like), if the user wants to control a shooting module of the wearable device to shoot a picture so as to share the picture with a video call object, the user can only switch an interface of the video call from a foreground to a background, and then can switch the interface of the video call from the background to the foreground again after shooting the picture by using the shooting module of the wearable device and sending the picture to the video call object. Therefore, the current method cannot realize picture shooting and sharing on the premise of not hiding the video call interface, so that if a user wants to shoot and share a picture in the video call process, the video call interface needs to be stopped, and the video call experience of the user is further influenced.

Disclosure of Invention

The embodiment of the invention discloses an image shooting method and wearable equipment in a video call process, which can shoot and share pictures on the premise of not stopping the video call so as to improve the use experience of a user.

The first aspect of the embodiment of the invention discloses an image shooting method in a video call process, which is applied to an intelligent host machine included in wearable equipment, wherein the intelligent host machine is rotatably connected to a bottom bracket of the wearable equipment, the intelligent host machine comprises a host machine top side and a host machine bottom side which are arranged oppositely, the host machine top side and the host machine bottom side are respectively provided with a shooting module, and the method comprises the following steps:

the intelligent host detects whether an opening instruction for opening a second shooting module is received or not in the process of carrying out video call with the video terminal by using the first shooting module; when the first shooting module is arranged on the top side of the host, the second shooting module is arranged on the bottom side of the host, and when the first shooting module is arranged on the bottom side of the host, the second shooting module is arranged on the top side of the host;

when the intelligent host receives the opening instruction, judging the instruction type corresponding to the opening instruction;

when the intelligent host judges that the instruction type indicates to control the second shooting module to shoot images, the intelligent host acquires a shooting time point of a previous frame of video image at the current time point as a first time point, and calculates a shooting time point of a next frame of video image of the previous frame of video image as a second time point according to the first time point;

the intelligent host judges whether the interval duration between the current time point and the second time point is greater than a preset threshold value or not;

when the interval duration is greater than the preset threshold value, the intelligent host controls the rotatable reflector built in the intelligent host to rotate to a first preset angle and controls the rotatable pentaprism built in the intelligent host to rotate to a second preset angle, and then controls the second shooting module to shoot images;

and the intelligent host sends the image shot by the second shooting module to the video terminal.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, after the intelligent host controls the second shooting module to shoot an image, the method further includes:

the intelligent host controls the rotatable reflector at the first preset angle to rotate to a third preset angle and controls the rotatable pentaprism at the second preset angle to rotate to a fourth preset angle; the third preset angle is the same as the first preset angle in size and opposite to the rotating direction of the first preset angle, and the fourth preset angle is the same as the second preset angle in size and opposite to the rotating direction of the second preset angle;

and the intelligent host controls the first shooting module to shoot the next frame of video image and sends the next frame of video image to the video terminal.

As an optional implementation manner, in a first aspect of an embodiment of the present invention, the sending, by the smart host, the image captured by the second capture module to the video terminal includes:

the intelligent host acquires the image shot by the second shooting module;

the intelligent host displays the image in a video call interface in a floating window mode;

the intelligent host judges whether a sending instruction which is input by a user in the floating window and agrees to send the image is detected;

and if so, the intelligent host sends the image to the video terminal.

As an optional implementation manner, in the first aspect of this embodiment of the present invention, the method further includes:

when the intelligent host does not detect a sending instruction for sending the image, closing the floating window and storing the image into a cache;

when detecting an image calling instruction, the intelligent host acquires the image from the cache again and sends the image to the video terminal;

and the intelligent host deletes the image stored in the cache when detecting that the video call is ended.

the intelligent host acquires account information of the video terminal and generates a specified identifier according to the account information;

the intelligent host establishes a matching relation for the designated identification, the image and the video terminal;

and the intelligent host sends the image to the video terminal according to the matching relation.

A second aspect of an embodiment of the present invention discloses a wearable device, including an intelligent host, the intelligent host being rotatably connected to a bottom bracket of the wearable device, the intelligent host including a host top side and a host bottom side that are opposite to each other, the host top side and the host bottom side each having a camera module, the intelligent host including:

the detection unit is used for detecting whether an opening instruction for opening the second shooting module is received or not in the process of carrying out video call with the video terminal by utilizing the first shooting module; when the first shooting module is arranged on the top side of the host, the second shooting module is arranged on the bottom side of the host, and when the first shooting module is arranged on the bottom side of the host, the second shooting module is arranged on the top side of the host;

the first judging unit is used for judging the instruction type corresponding to the opening instruction when the detecting unit receives the opening instruction;

the calculating unit is used for acquiring a shooting time point of a previous frame video image of a current time point as a first time point and calculating a shooting time point of a next frame video image of the previous frame video image as a second time point according to the first time point when the first judging unit judges that the instruction type indicates to control the second shooting module to shoot the image;

the second judging unit is used for judging whether the interval duration between the current time point and the second time point is greater than a preset threshold value or not;

the first control unit is used for controlling the rotatable reflector built in the intelligent host to rotate to a first preset angle and controlling the rotatable pentaprism built in the intelligent host to rotate to a second preset angle when the second judging unit judges that the interval duration is greater than the preset threshold value, and then controlling the second shooting module to shoot images;

and the first sending unit is used for sending the image shot by the second shooting module to the video terminal.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, the smart host further includes:

the second control unit is used for controlling the rotatable reflector at the first preset angle to rotate to a third preset angle and controlling the rotatable pentaprism at the second preset angle to rotate to a fourth preset angle after the first control unit controls the second shooting module to shoot images; the third preset angle is the same as the first preset angle in size and opposite to the rotating direction of the first preset angle, and the fourth preset angle is the same as the second preset angle in size and opposite to the rotating direction of the second preset angle;

and the second sending unit is used for controlling the first shooting module to shoot the next frame of video image and sending the next frame of video image to the video terminal after the second control unit controls the rotatable reflector at the first preset angle to rotate to a third preset angle and controls the rotatable pentaprism at the second preset angle to rotate to a fourth preset angle.

As an optional implementation manner, in the second aspect of the embodiment of the present invention, a manner that the first sending unit is configured to send the image captured by the second capturing module to the video terminal is specifically:

the first sending unit is used for acquiring the image shot by the second shooting module; displaying the image in a video call interface in a floating window mode; judging whether a sending instruction which is input by a user in the floating window and agrees to send the image is detected; and when a sending instruction for sending the image is detected, sending the image to the video terminal.

a closing unit, configured to close the floating window and store the image in a cache when the first sending unit does not detect a sending instruction for sending the image;

the first sending unit is further configured to, when an image call instruction is detected, obtain the image from the cache again and send the image to the video terminal;

and the deleting unit is used for deleting the image stored in the cache when the video call is detected to be ended.

the first sending unit is used for acquiring account information of the video terminal and generating a specified identifier according to the account information; establishing a matching relation for the designated identification, the image and the video terminal; and sending the image to the video terminal according to the matching relation.

A third aspect of an embodiment of the present invention discloses a wearable device, where the wearable device includes an intelligent host, the intelligent host is rotatably connected to a bottom bracket of the wearable device, the intelligent host includes a host top side and a host bottom side, which are opposite to each other, the host top side and the host bottom side are respectively provided with a shooting module, and the intelligent host includes:

a memory storing executable program code;

a processor coupled with the memory;

the processor calls the executable program code stored in the memory to execute the image shooting method in the video call process disclosed by the first aspect of the embodiment of the invention.

A fourth aspect of the embodiments of the present invention discloses a computer-readable storage medium storing a computer program, where the computer program causes a computer to execute an image capturing method in a video call process disclosed in the first aspect of the embodiments of the present invention.

A fifth aspect of the embodiments of the present invention discloses a computer program product, which, when running on a computer, causes the computer to perform part or all of the steps of any one of the methods of the first aspect of the embodiments of the present invention.

A sixth aspect of the present embodiment discloses an application publishing platform, where the application publishing platform is configured to publish a computer program product, where when the computer program product runs on a computer, the computer is caused to perform part or all of the steps of any one of the methods in the first aspect of the present embodiment.

Compared with the prior art, the embodiment of the invention has the following beneficial effects:

in the embodiment of the invention, the intelligent host can detect whether an instruction for starting the second shooting module to shoot the image is received or not in the process of video call; if so, judging whether the interval duration between the current time point and the time point of shooting the next frame of video image by the first shooting module is greater than a preset threshold value or not; if the interval duration is larger than the preset threshold value, the interval duration is utilized to control the rotatable reflector and the rotatable pentaprism to rotate to the preset angle, and then the second shooting module is controlled to shoot images and send the shot images to the video terminal. By implementing the method, the wearable device with the double shooting modules is utilized, videos are carried out through one shooting module, images are shot in the process of two frames of video images through the other shooting module, the images are sent to the video terminal, the images can be shot and shared on the premise of not stopping video calls, and the use experience of users is improved.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a wearable device disclosed in an embodiment of the present invention;

fig. 2 is a schematic structural diagram of the wearable device shown in fig. 1 including the smart host rotated 90 ° with respect to the bottom bracket;

FIG. 3 is a schematic view of another perspective of FIG. 2;

FIG. 4 is a flowchart illustrating an image capturing method during a video call according to an embodiment of the present disclosure;

FIG. 5 is a flowchart illustrating another method for capturing images during a video call according to an embodiment of the present disclosure;

FIG. 6 is a schematic structural diagram of an intelligent host according to an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of another smart host disclosed in the embodiments of the present invention;

FIG. 8 is a schematic structural diagram of another smart host disclosed in the embodiments of the present invention;

fig. 9 is a schematic rotation diagram of the rotatable light reflecting plate and the rotatable pentaprism according to the embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In the present invention, the terms "upper", "lower", "left", "right", "front", "rear", "top", "bottom", "inner", "outer", "center", "vertical", "horizontal", "lateral", "longitudinal", and the like indicate an orientation or positional relationship based on the orientation or positional relationship shown in the drawings. These terms are used primarily to better describe the invention and its embodiments and are not intended to limit the indicated devices, elements or components to a particular orientation or to be constructed and operated in a particular orientation.

Moreover, some of the above terms may be used to indicate other meanings besides the orientation or positional relationship, for example, the term "on" may also be used to indicate some kind of attachment or connection relationship in some cases. The specific meanings of these terms in the present invention can be understood by those skilled in the art as appropriate.

Furthermore, the terms "mounted," "disposed," "provided," "connected," and "connected" are to be construed broadly. For example, it may be a fixed connection, a removable connection, or a unitary construction; can be a mechanical connection, or an electrical connection; may be directly connected, or indirectly connected through intervening media, or may be in internal communication between two devices, elements or components. The specific meanings of the above terms in the present invention can be understood by those of ordinary skill in the art according to specific situations.

It is to be noted that the terms "first", "second", and the like in the description and claims of the present invention are used for distinguishing different objects, and are not used for describing a specific order. The terms "comprises," "comprising," and any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

The technical solution of the present invention will be described in detail with reference to specific examples.

In order to better understand the image capturing method in the video call process disclosed in the embodiment of the present invention, a wearable device disclosed in the embodiment of the present invention is described first. Referring to fig. 1 to fig. 3, a wearable device disclosed in an embodiment of the present invention may include: bottom support 10, intelligent host computer 20 and side area 30, bottom support 10 is connected between the both sides area tip of side area 30. Host top side 20a of intelligent host 20 is just to host bottom side 20b of intelligent host 20 to host top side 20a of intelligent host 20 is equipped with shoots module 22, and host bottom side 20b of intelligent host 20 is equipped with shoots module 23. The one end of intelligent host 20 is passed through first pivot 21 and is connected with the first end rotation of bottom sprag 10, and intelligent host 20 can rotate different angles relatively bottom sprag 10 to make and shoot module 22, shoot module 23 and can obtain different shooting angles. One end of the side belt 30 is coupled to the first end of the bottom bracket 10 via the first rotating shaft 21, and the other end of the side belt 30 is connected to the second end of the bottom bracket 10.

In the wearable device disclosed in the embodiment of the present invention, with the above-described structure, the smart host 20 included in the wearable device is rotatably provided between both side band ends of the side band 30 included in the wearable device. Wherein, can realize the rotation of the relative bottom sprag 10 of intelligent host 20 through first pivot 21 to make the shooting module 22 of locating intelligent host 20, shoot module 23 and also can obtain different shooting angles along with intelligent host 20's rotation, this problem of the adjustment shooting angle that current wearable equipment (usually only have one top side to shoot the module) need the social user to twist reverse the arm and can realize has not only been solved, still can satisfy the shooting demand of the different angles of social user simultaneously.

In the embodiment of the present invention, when the smart host 20 rotates relative to the bottom chassis 10, because one end of the side band 30 is coupled to the first end of the bottom chassis 10 through the first rotating shaft 21, the coaxial rotation design of the first rotating shaft 21 is shared among the one end of the side band 30, the first end of the bottom chassis 10, and one end of the smart host 20, so as to reduce the component design of the wearable device, simplify the component assembly process of the wearable device, and further make the structure of the wearable device more compact.

In the embodiment of the present invention, a top-side display screen (not labeled in the figure) may be disposed on the host top-side 20a of the smart host 20; optionally, a bottom-side display screen (not labeled) may also be disposed on the host bottom side 20b of the smart host 20. In a normal case, the smart host 20 may be stacked on the bottom chassis 10, i.e. the host bottom side 20b of the smart host 20 is attached to the upper surface of the bottom chassis 10; when the smart host 20 rotates around the first rotation axis 21, the host top side 20a and the host bottom side 20b of the smart host 20 form an angle with the upper surface of the bottom bracket 10.

In the embodiment of the present invention, the smart host 20 is used as a host of a wearable device with adjustable shooting angle, and includes not only an internal motherboard, a touch screen/display screen for implementing touch and display functions, a battery for supplying power to the motherboard, the touch screen/display screen, a shooting module 22 and a shooting module 23 for implementing the shooting function of the smart host 20, a communication device (e.g., a wireless communication device, a bluetooth communication device, an infrared communication device, etc.) for implementing the communication function of the smart host 20, a sensor (e.g., a gravity sensor, an acceleration sensor, a distance sensor, an air pressure sensor, an ultraviolet detector, a water playing detection and identification module) for implementing the detection function of the smart host 20, a heart rate detector for implementing the heart rate detection of the user, a timer for implementing the timing function of the smart host 20, a timer for implementing the timing function, The device comprises components for identifying the identity of a user, such as a fingerprint module, a facial recognition module, a microphone for realizing audio input and/or output, a loudspeaker and the like. It should be known that, inside each above-mentioned device, functional module all located intelligent host 20, and be connected with the mainboard electricity, realize the control to these devices, functional module through the mainboard, and then control it and realize corresponding function.

Therefore, in the embodiment of the present invention, the smart host 20 is different from a traditional watch dial that only can implement functions of time display, timing, and the like.

Further, rotatable coupling can be realized through first pivot 21 to intelligent host 20 and bottom sprag 10, consequently, can adjust the shooting angle of shooing module 22 and shooting module 23 through the turned angle of adjusting intelligent host 20 and bottom sprag 10, and wherein, the turned angle of intelligent host 20 and bottom sprag 10 can be between 0 ~ 90. For example, when the smart host 20 is stacked on the bottom chassis 10, the angle between the smart host 20 and the bottom chassis 10 is 0 °, and when the smart host 20 is rotated, the angle between the smart host 20 and the bottom chassis 10 may preferably be 90 °. When the angle between the intelligent host 20 and the bottom bracket 10 is 0 degree, the included angle between the shooting module 22 and the shooting module 23 on the intelligent host 20 relative to the bottom bracket 10 is also 0 degree; when intelligent host 20 rotated the relative bottom support 10 and formed 90 contained angles, intelligent host 20's shooting module 22 and shooting module 23 contained angle relative bottom support 10 were 90 contained angles to can realize shooting module 22 and the adjustment of shooting module 23's shooting angle. Especially, when being provided with the top side display screen on the host computer top side 20a of intelligent host 20 and also being provided with the bottom side display screen on host computer bottom side 20b, if the contained angle of shooting module 22 and the relative bottom sprag 10 of shooting module 23 of intelligent host 20 is 90 contained angles, then the contained angle that the relative bottom sprag 10 of bottom side display screen that sets up on the top side display screen of host computer 20a and the host computer bottom side 20b was also 90 contained angles, thereby can conveniently be located the user of intelligent host 20 one side and watch the top side display screen, and conveniently be located the user of intelligent host 20 opposite side and watch the bottom side display screen. In the embodiment of the present invention, the rotation angle between the intelligent host 20 and the bottom bracket 10 can be adjusted between 0 ° and 90 °, and preferably, the rotation angle can be 0 °, 30 °, 45 °, 60 °, 75 °, or 90 °.

In the embodiment of the present invention, since the smart host 20 is rotatably connected to the bottom bracket 10 through the first rotating shaft 21, the smart host 20 may include a rotating end 20c and a free end 20d, which are oppositely disposed, the rotating end 20c is an end of the smart host 20 connected to the first end of the bottom bracket 10 through the first rotating shaft 21, and the free end 20d is an end that can rotate with the rotating end 20c relative to the bottom bracket 10 and form an angle with respect to the bottom bracket 10. Specifically, in order to avoid affecting the shooting angle of view of the shooting module 22 and the shooting module 23, the shooting module 22 may be preferably disposed on the top side of the end portion of the free end 20d (belonging to a portion of the host top side 20 a), and the shooting module 23 may be preferably disposed on the bottom side of the end portion of the free end 20d (belonging to a portion of the host bottom side 20 b).

In an embodiment of the present invention, the bottom bracket 10 may have a plate-shaped structure. When the bottom bracket 10 is a plate-shaped structure, the material of the bottom bracket 10 may preferably be a heat insulating material, such as plastic. When the user wears the wearable device, the situation that the heat generation amount of the smart host 20 is large and the wrist skin of the user is possibly scalded can be avoided. Therefore, the bottom bracket 10 not only can realize the function of bearing the rotation of the smart host 20, but also can realize the effect of insulating the smart host 20 from the wrist skin of the user.

Further, when the bottom bracket 10 is a plate-shaped structure, one or more through holes 10a may be disposed on the bottom bracket 10, so that the smart host 20 may implement various physiological feature detections including detection of the heart rate of the user through the through holes 10 a. The shape of the through hole 10 may be circular, square, or oval, and the embodiment of the present invention is not limited.

It is understood that the bottom bracket 10 may be a closed ring structure in other embodiments, and the embodiments of the present invention are not limited thereto.

When the user needs to adjust the angle of intelligent host 20 relative bottom support 10, the turned angle of accessible manual adjustment intelligent host 20 relative bottom support 10, when intelligent host 20 rotated to user's target angle, this moment, the user stopped adjusting intelligent host 20, intelligent host 20 can keep unchangeable at current angle, at this moment, it can be in the state of shooing to shoot module 22 and/or shoot module 23, the user can select to shoot module 22 and/or shoot module 23 and carry out corresponding shooting operation according to the actual demand of shooing.

When the user wants to stack the smart host 20 on the bottom bracket 10, the user can manually adjust the smart host 20 again, so that the smart host 20 can be adjusted again to rotate relative to the bottom bracket 10 until the smart host 20 is stacked on the bottom bracket 10, and the user stops adjusting the smart host 20.

The wearable device disclosed by the embodiment of the invention enables the shooting module 22 and the shooting module 23 to obtain different shooting angles along with the rotation of the intelligent host, and meets the requirements of users on different shooting angles.

Example one

Referring to fig. 4, fig. 4 is a flowchart illustrating an image capturing method during a video call according to an embodiment of the present invention. The image capturing method during the video call described in fig. 4 can be applied to the wearable device described in the foregoing embodiment. As described in the previous embodiments, the wearable device includes a smart host, and the smart host is rotatably connected to the bottom bracket of the wearable device, the smart host includes a host top side and a host bottom side which are oppositely disposed, and the host top side and the host bottom side are respectively provided with a shooting module. As shown in fig. 4, the image capturing method during the video call may include the steps of:

401. the intelligent host detects whether an opening instruction for opening the second shooting module is received or not in the process of utilizing the first shooting module to carry out video call with the video terminal.

In the embodiment of the invention, when the first shooting module is the shooting module arranged on the top side of the host, the second shooting module is the shooting module arranged on the bottom side of the host, and when the first shooting module is the shooting module arranged on the bottom side of the host, the second shooting module is the shooting module arranged on the top side of the host.

As an optional implementation manner, the intelligent host may analyze voice information of the user during the video call, and when a keyword indicating that the user wants to perform image shooting is collected (for example, "this picture is good, i shoot for you," "i share a note for you," etc.), open the second shooting module and perform the step of image shooting.

By implementing the method, the intelligent host can continuously learn and collect the keywords indicating that the user wants to execute image shooting, and the second shooting module is started to shoot the image when the keywords are detected, so that a more intelligent image shooting process is realized, and the use experience of the user is improved.

As another optional implementation, a voiceprint library may be further built in the smart host, the user may enter his/her voice into the smart host in advance, the smart host extracts voiceprint features from the entered voice, and stores the extracted voiceprint features and the entered voice in association with each other in the voiceprint library. When the intelligent host detects voice information of a user in the video call process, voiceprint features can be extracted from the voice information, whether the extracted voiceprint features are matched with voiceprint features stored in a voiceprint library or not is judged, and if yes, a step of analyzing keywords in the voice information is executed.

By implementing the method, the problem that the recognition efficiency of the intelligent host is influenced by the speaking voice or noise of other people can be avoided, and the accuracy of recognizing the voice command by the intelligent host is improved.

402. When the intelligent host receives the opening instruction, judging whether the instruction type corresponding to the opening instruction indicates to control the second shooting module to shoot the image; if yes, go to step 403; if not, the flow is ended.

In the embodiment of the present invention, the type of the instruction corresponding to the start instruction may be to instruct the shooting module to perform image shooting, video shooting, or scanning two-dimensional code information, and the like.

403. The intelligent host acquires the shooting time point of the previous frame of video image of the current time point as a first time point, and calculates the shooting time point of the next frame of video image of the previous frame of video image as a second time point according to the first time point.

For example, when the intelligent host determines that the type of the instruction corresponding to the start instruction for starting the second shooting module is used for instructing the second shooting module to shoot images, the intelligent host obtains the current time point X, and then the intelligent host can obtain the shooting time point Y of the previous frame of video image according to the X, and since the interval duration for shooting the two consecutive frames of video images is known, assuming that the interval duration for shooting the two consecutive frames of video images is Z, the intelligent host can calculate the shooting time point of the next frame of video image of the previous frame of video image to be Y + Z.

404. The intelligent host judges whether the interval duration between the current time point and the second time point is greater than a preset threshold value or not; if so, go to step 405; if not, the flow is ended.

In the embodiment of the invention, the intelligent host judges whether the interval duration between the current time point and the second time point is greater than a preset threshold value or not, so as to determine whether the interval duration between the current time point and the second time point is enough for the second shooting module to shoot the image. Wherein the time length required for the whole image shooting process at least comprises: the time length required by rotating the rotatable reflector, the time length required by rotating the rotatable pentaprism and the time length required by the shooting module to execute image shooting.

405. After the rotatable reflector plate arranged in the intelligent host is controlled to rotate to a first preset angle and the rotatable pentaprism arranged in the intelligent host is controlled to rotate to a second preset angle, the second shooting module is controlled to shoot images.

In the embodiment of the invention, when the interval duration of the intelligent host is greater than the preset threshold, the rotatable reflector built in the intelligent host is controlled to rotate to the first preset angle and the rotatable pentaprism built in the intelligent host is controlled to rotate to the second preset angle so as to enable the second shooting module to normally image and further control the second shooting module to shoot images.

In the embodiment of the present invention, a user may control the second shooting module to shoot an image by clicking a virtual key displayed in the video call interface and used for executing image shooting, or pressing a volume key or other physical keys.

As an alternative embodiment, the smart host may default that the user wants to capture the image if the smart host detects that the propagation path of the light (shown as a dotted line in fig. 9) is cut off during the process of controlling the first capture module to capture the video image. Further, the smart host may regard the time point at which the propagation path of the light is cut off as the "current time point" mentioned in the above embodiment, and determine whether the interval duration between the "cut-off time point" (i.e., the current time point) and the second time point is greater than the preset threshold according to the above method. If the angle of the rotating reflector is larger than the first preset angle, the rotating reflector arranged in the intelligent host is controlled to rotate to the first preset angle, the rotating pentaprism arranged in the intelligent host is controlled to rotate to the second preset angle, and then the second shooting module is controlled to shoot images. The condition that the propagation path of the light is cut off may be caused by a user covering a lens of the first photographing module with a finger.

In practice, it is found that the function of controlling image shooting performed by the physical key such as the volume key may conflict with the original trigger function transmission of the physical key; and the virtual key for executing image shooting is displayed in the call interface, so that the call interface is shielded, and the video call experience of the user is further influenced. If the method is implemented, the user can touch the lens of the shooting module by fingers, and the intelligent host can default the action that the user covers the lens to cut off the light propagation path as the trigger condition for executing image shooting. And then can let the user control the intelligent host computer to carry out image shooting at the in-process of video conversation with a simple and convenient mode on the premise of not sheltering from the video conversation interface and guaranteeing that the entity button can realize its original trigger function.

406. The intelligent host sends the image shot by the second shooting module to the video terminal.

As an optional implementation manner, the manner in which the intelligent host sends the image shot by the second shooting module to the video terminal may be: the intelligent host acquires an image shot by the second shooting module; displaying the image in a video call interface in a suspension window mode; the intelligent host judges whether a sending instruction which agrees to send the image and is input by a user in the floating window is detected; and when detecting the sending instruction, sending the image to the video terminal.

By implementing the method, the image is displayed in the interface of the video call in a floating window mode, and an image previewing mode can be provided on the premise that the normal video call of the user is not influenced as much as possible, so that the user can adjust the shot image and further determine whether to send the image to the video terminal, and the use experience of the user is improved.

As another alternative, the intelligent host may display an image on a display screen originally used for displaying the video call interface when detecting a switching instruction of the user; an editing function is started, the image editing operation of a user is further detected, and when the image editing is completed, the video call interface and the image are switched back to the original display mode; the switching instruction is used for switching the video image in the video call interface and the image displayed by the floating window.

By implementing the method, the user can switch the shot image to the display screen to preview in more detail; and corresponding editing operation can be carried out on the image so as to obtain a more satisfactory image. The use experience of the user is improved.

As another alternative, the smart host may close the floating window and store the image in the cache when the sending instruction for sending the image is not detected; when the intelligent host detects the image calling instruction, the intelligent host can acquire the image from the cache again and send the image to the video terminal; and the intelligent host can delete the images stored in the cache when detecting the end of the video call.

By implementing the method, the images shot by the user in the video call process can be backed up, and the user can call the images at any time, so that the use experience of the user is improved; in addition, when the end of the video call is detected, the image stored in the cache is deleted, so that the internal storage space of the intelligent host can be saved.

As another optional implementation, the manner in which the intelligent host sends the image shot by the second shooting module to the video terminal may also be: the method comprises the steps that an intelligent host acquires account information of a video terminal and generates a specified identifier according to the account information; the intelligent host establishes a matching relation for the designated identification, the image and the video terminal; and sending the image to the video terminal according to the matching relation.

By implementing the method, the matching relation is established for the image and the video terminal, so that the image can be accurately transmitted to the video terminal, the situation of image mistransmission is avoided, and the privacy of a user is prevented from being revealed.

As described in the method of fig. 1, the intelligent host may detect whether an instruction to start the second shooting module to shoot an image is received during the video call; if so, judging whether the interval duration between the current time point and the time point of shooting the next frame of video image by the first shooting module is greater than a preset threshold value or not; if the interval duration is larger than the preset threshold value, the interval duration is utilized to control the rotatable reflector and the rotatable pentaprism to rotate to the preset angle, and then the second shooting module is controlled to shoot images and send the shot images to the video terminal. By implementing the method, the picture can be shot and shared on the premise of not stopping the video call, and the use experience of the user is improved.

Example two

Referring to fig. 5, fig. 5 is a schematic flowchart illustrating another image capturing method in a video call process according to an embodiment of the present invention. The image capturing method during the video call described in fig. 5 can be applied to the wearable device described in the foregoing embodiment. As described in the previous embodiments, the wearable device includes a smart host, and the smart host is rotatably connected to the bottom bracket of the wearable device, the smart host includes a host top side and a host bottom side which are oppositely disposed, and the host top side and the host bottom side are respectively provided with a shooting module. As shown in fig. 5, the image capturing method during the video call may include the steps of:

501-505; wherein, steps 501 to 505 are the same as steps 401 to 405 in the first embodiment, and are not described herein again.

506. The intelligent host controls the rotatable reflector at the first preset angle to rotate to a third preset angle and controls the rotatable pentaprism at the second preset angle to rotate to a fourth preset angle.

In the embodiment of the present invention, the third predetermined angle is the same as the first predetermined angle and the third predetermined angle is opposite to the rotation direction of the first predetermined angle, and the fourth predetermined angle is the same as the second predetermined angle and the fourth predetermined angle is opposite to the rotation direction of the second predetermined angle.

Referring to fig. 9, fig. 9 is a schematic rotation diagram of a rotatable light reflecting plate and a rotatable pentaprism according to an embodiment of the disclosure, wherein a dotted line represents a propagation path of light. As shown in the figure, the rotatable reflector at the first preset angle and the rotatable pentaprism at the second preset angle can enable the second shooting module to normally image, and further can control the second shooting module to shoot images; after the image shooting is completed, the rotatable reflector at the first preset angle is rotated to a third preset angle, and the rotatable pentaprism at the second preset angle is controlled to rotate to a fourth preset angle, so that the first shooting module (known from the previous embodiment, the shooting directions of the first shooting module and the second shooting module are opposite) can normally image, and the first shooting module can be controlled to shoot a next frame of video image.

According to the method, on the premise that only one reflector and one pentaprism are used, two shooting modules with opposite shooting directions can normally image in a mode of rotating the reflector and the pentaprism, namely, the structure of the double cameras is simplified, the manufacturing cost is reduced, and the processing efficiency of the central processing unit of the intelligent host can be maximized.

507. The intelligent host controls the first shooting module to shoot a next frame of video image and sends the next frame of video image to the video terminal.

In the embodiment of the invention, after the intelligent host controls the rotatable reflector rotating to the third preset angle and the rotatable pentaprism rotating to the fourth preset angle, the intelligent host controls the first shooting module to shoot the next frame of video image and sends the next frame of video image to the video terminal. The next frame of video image can be connected with the previous frame of video image to ensure that the video call interface is normally played.

508 of the first and second substrates; step 508 is the same as step 406 in the first embodiment, and is not described herein again.

The method described in fig. 2, according to the structural characteristic that the intelligent host is internally provided with the rotatable reflector and the rotatable pentaprism, can enable two shooting modules with opposite shooting directions to normally image in a manner of rotating the reflector and the pentaprism on the premise of only using one reflector and one pentaprism, namely, simplifies the structure of the double cameras, reduces the manufacturing cost, and can maximize the processing efficiency of the central processing unit of the intelligent host. In addition, pictures can be shot and shared on the premise of not stopping video call, so that the use experience of a user is improved.

EXAMPLE III

Referring to fig. 6, fig. 6 is a schematic structural diagram of an intelligent host according to an embodiment of the present invention. Wherein, this intelligent host connects in wearable equipment's bottom support with rotatable mode, and this intelligent host is including just to host computer top side and the host computer bottom side of setting, and host computer top side and host computer bottom side are equipped with one respectively and shoot the module moreover. As shown in fig. 6, the smart host may include:

the detecting unit 601 is configured to detect whether an opening instruction for opening the second shooting module is received in a process of performing a video call with the video terminal by using the first shooting module; when the first shooting module is a shooting module arranged on the top side of the host, the second shooting module is a shooting module arranged on the bottom side of the host, and when the first shooting module is a shooting module arranged on the bottom side of the host, the second shooting module is a shooting module arranged on the top side of the host;

a first determining unit 602, configured to determine, when the detecting unit 601 receives the start instruction, an instruction type corresponding to the start instruction;

a calculating unit 603, configured to, when the first determining unit 602 determines that the instruction type indicates to control the second shooting module to shoot an image, obtain a shooting time point of a previous frame of video image at a current time point as a first time point, and calculate a shooting time point of a next frame of video image of the previous frame of video image according to the first time point as a second time point;

a second determining unit 604, configured to determine whether an interval duration between the current time point and the second time point is greater than a preset threshold;

the first control unit 605 is configured to control the rotatable reflector built in the intelligent host to rotate to a first preset angle and control the rotatable pentaprism built in the intelligent host to rotate to a second preset angle when the second determination unit 604 determines that the interval duration is greater than the preset threshold, and then control the second shooting module to shoot images;

and a first sending unit 606, configured to send the image captured by the second capture module to the video terminal.

As an alternative embodiment, the detection unit 601 may be provided with a voice detection module inside, and is configured to analyze voice information during a video call of a user, and when a keyword indicating that the user wants to perform image capturing is collected (for example, "this picture is good, i capture and see you," "i share and take notes to you," etc.), start the second capturing module and perform the step of image capturing.

By implementing the method, the detection unit 601 can continuously learn and collect the keywords indicating that the user wants to execute image shooting, and start the second shooting module to shoot the image when detecting the keywords, so that a more intelligent image shooting process is realized, and the use experience of the user is improved.

As another alternative, the detection unit 601 may also have a voiceprint library built therein, wherein the voiceprint library may be associated with the voice detection module. The user can record own voice into the voice detection module in advance, the voice detection module extracts the voiceprint characteristics of the recorded voice, and the extracted voiceprint characteristics and the recorded voice are stored in the voiceprint library in a correlation mode. When the voice detection module detects voice information in the video call process of a user, voiceprint features can be extracted from the voice information, whether the extracted voiceprint features are matched with voiceprint features stored in a voiceprint library or not is judged, and if the extracted voiceprint features are matched with the voiceprint features, the step of analyzing keywords in the voice information is executed.

By implementing the method, the voice recognition efficiency of the voice detection module can be prevented from being influenced by the speaking voice or noise of other people, and the accuracy of the voice command recognition of the voice detection module is improved.

As an alternative embodiment, the first control unit 605 may be configured to detect whether a propagation path of light entering the first photographing module is cut off, and if the propagation path of light is cut off, the user may default to image photographing. Further, the first control unit 605 may regard a point of time at which the propagation path of the light is cut off as the "current point of time" mentioned in the above-described embodiment, and determine whether or not the interval duration of the "cut-off point of time" (i.e., the current point of time) and the second point of time is greater than a preset threshold value according to the above-described method. If the angle of the rotating reflector is larger than the first preset angle, the rotating reflector arranged in the intelligent host is controlled to rotate to the first preset angle, the rotating pentaprism arranged in the intelligent host is controlled to rotate to the second preset angle, and then the second shooting module is controlled to shoot images. The condition that the propagation path of the light is cut off may be caused by a user covering a lens of the first photographing module with a finger.

By implementing the method, the user can touch the lens of the shooting module by fingers, and the first control unit 605 can default the action of blocking the lens by the user so as to cut off the light propagation path as the trigger condition for executing the image shooting, so that the user can control the intelligent host to execute the image shooting in the video call process in a simple and convenient manner on the premise of not blocking the video call interface and ensuring that the entity key can realize the original trigger function.

As described in fig. 6, the intelligent host may detect whether an instruction to start the second shooting module to shoot an image is received during the video call; if so, judging whether the interval duration between the current time point and the time point of shooting the next frame of video image by the first shooting module is greater than a preset threshold value or not; if the interval duration is larger than the preset threshold value, the interval duration is utilized to control the rotatable reflector and the rotatable pentaprism to rotate to the preset angle, and then the second shooting module is controlled to shoot images and send the shot images to the video terminal. By implementing the method, the picture can be shot and shared on the premise of not stopping the video call, and the use experience of the user is improved.

Example four

Referring to fig. 7, fig. 7 is a schematic structural diagram of another intelligent host disclosed in the embodiment of the present invention. The smart host shown in fig. 7 is optimized by the smart host shown in fig. 6. Compared with the smart host shown in fig. 6, the smart host shown in fig. 7 may further include:

the second control unit 607 is configured to control the rotatable reflector at the first preset angle to rotate to a third preset angle and control the rotatable pentaprism at the second preset angle to rotate to a fourth preset angle after the first control unit 605 controls the second shooting module to shoot images; the third preset angle is the same as the first preset angle and is opposite to the rotating direction, and the fourth preset angle is the same as the second preset angle and is opposite to the rotating direction;

a second sending unit 608, configured to control the first shooting module to shoot a next frame of video image and send the next frame of video image to the video terminal after the second control unit 607 controls the rotatable reflector at the first preset angle to rotate to a third preset angle and controls the rotatable pentaprism at the second preset angle to rotate to a fourth preset angle;

the first sending unit 606 is further configured to obtain an image captured by the second capture module; displaying the image in a video call interface in a suspension window mode; judging whether a sending instruction which agrees to send the image and is input by the user in the floating window is detected; when a sending instruction for sending the image is detected, sending the image to the video terminal;

a closing unit 609, configured to close the floating window and store the image in the cache when the first sending unit 606 does not detect a sending instruction for sending the image;

the first sending unit 606 is further configured to, when the image call instruction is detected, obtain an image from the cache again and send the image to the video terminal;

a deleting unit 610 configured to delete the image stored in the cache when detecting that the video call is ended;

the first sending unit 606 is configured to obtain account information of the video terminal, and generate a specified identifier according to the account information; establishing a matching relation for the designated identification, the image and the video terminal; and sending the image to the video terminal according to the matching relation.

As an optional implementation manner, the first sending unit 606 may further have a built-in switching unit, where the switching unit is configured to switch a video image in the video call interface and an image displayed on the floating window, so as to display the image on a display screen that is originally used for displaying the video call interface; and starting an editing function, further detecting the image editing operation of a user, and switching the video call interface and the image back to the original display mode when the image editing completion is received.

Compared with the intelligent host described in fig. 6, the intelligent host described in fig. 7 can also enable two shooting modules with opposite shooting directions to normally image in a manner of rotating the reflector and the pentaprism on the premise of only using one reflector and one pentaprism according to the structural characteristic that the rotatable reflector and the rotatable pentaprism are built in the intelligent host, namely, the structure of the double cameras is simplified, the manufacturing cost is reduced, and the processing efficiency of the central processing unit of the intelligent host can be maximized; and also provides an image preview mode, so that a user can adjust the shot image to further determine whether to send the image to the video terminal; images shot by a user in the video call process can be backed up, and the user can call the images at any time, so that the use experience of the user is improved; in addition, when the video call is detected to be finished, the image stored in the cache is deleted, so that the internal storage space can be saved for the intelligent host; and establishing a matching relation for the image and the video terminal to ensure that the image can be accurately transmitted to the video terminal, so as to avoid the situation of image mistransmission and further avoid revealing the privacy of the user.

EXAMPLE five

Referring to fig. 8, fig. 8 is a schematic structural diagram of another intelligent host disclosed in the embodiment of the present invention. Wherein, this intelligent host connects in wearable equipment's bottom support with rotatable mode, and this intelligent host is including just to host computer top side and the host computer bottom side of setting, and host computer top side and host computer bottom side are equipped with one respectively and shoot the module moreover. As shown in fig. 8, the smart host may include:

a memory 801 in which executable program code is stored;

a processor 802 coupled with the memory 801;

the processor 802 calls the executable program code stored in the memory 801 to execute the image capturing method in any one of the video call processes of fig. 4 to 5.

The embodiment of the invention discloses a computer-readable storage medium which stores a computer program, wherein the computer program enables a computer to execute an image shooting method in any one of the video call processes of figures 4-5.

The embodiment of the present invention also discloses an application publishing platform, wherein the application publishing platform is used for publishing a computer program product, and when the computer program product runs on a computer, the computer is caused to execute part or all of the steps of the method in the above method embodiments.

In various embodiments of the present invention, it should be understood that the sequence numbers of the above-mentioned processes do not imply an inevitable order of execution, and the execution order of the processes should be determined by their functions and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated units, if implemented as software functional units and sold or used as a stand-alone product, may be stored in a computer accessible memory. Based on such understanding, the technical solution of the present invention, which is a part of or contributes to the prior art in essence, or all or part of the technical solution, can be embodied in the form of a software product, which is stored in a memory and includes several requests for causing a computer device (which may be a personal computer, a server, a network device, or the like, and may specifically be a processor in the computer device) to execute part or all of the steps of the above-described method of each embodiment of the present invention.

It will be understood by those skilled in the art that all or part of the steps in the methods of the embodiments described above may be implemented by hardware instructions of a program, and the program may be stored in a computer-readable storage medium, where the storage medium includes Read-Only Memory (ROM), Random Access Memory (RAM), Programmable Read-Only Memory (PROM), Erasable Programmable Read-Only Memory (EPROM), One-time Programmable Read-Only Memory (OTPROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Compact Disc Read-Only Memory (CD-ROM), or other Memory, such as a magnetic disk, or a combination thereof, A tape memory, or any other medium readable by a computer that can be used to carry or store data.

The image shooting method and the wearable device in the video call process disclosed by the embodiment of the invention are described in detail, a specific example is applied in the text to explain the principle and the implementation mode of the invention, and the description of the embodiment is only used for helping to understand the method and the core idea of the invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. An image shooting method in a video call process is applied to an intelligent host included in a wearable device, the intelligent host is rotatably connected to a bottom bracket of the wearable device, the intelligent host comprises a host top side and a host bottom side which are oppositely arranged, and the host top side and the host bottom side are respectively provided with a shooting module, the method comprises the following steps:

2. The method according to claim 1, wherein after the smart host controls the second photographing module to perform image photographing, the method further comprises:

the intelligent host controls the rotatable reflector at the first preset angle to rotate to a third preset angle and controls the rotatable pentaprism at the second preset angle to rotate to a fourth preset angle; when the rotatable reflector rotates to the third preset angle and the rotatable pentaprism rotates to the fourth preset angle, the rotatable reflector and the rotatable pentaprism transmit ambient light to the first shooting module, and when the rotatable reflector rotates to the first preset angle and the rotatable pentaprism rotates to the second preset angle, the rotatable reflector and the rotatable pentaprism transmit ambient light to the second shooting module;

3. The method according to claim 1 or 2, wherein the sending, by the smart host, the image shot by the second shooting module to the video terminal comprises:

the intelligent host acquires the image shot by the second shooting module;

and if so, the intelligent host sends the image to the video terminal.

4. The method of claim 3, further comprising:

5. The method according to claim 1 or 2, wherein the sending, by the smart host, the image shot by the second shooting module to the video terminal comprises:

6. A wearable device, wherein the wearable device comprises a smart host, wherein the smart host is rotatably connected to a bottom bracket of the wearable device, wherein the smart host comprises a host top side and a host bottom side that are opposite to each other, wherein each of the host top side and the host bottom side is provided with a camera module, and the smart host comprises:

7. The wearable device of claim 6, wherein the smart host further comprises:

the second control unit is used for controlling the rotatable reflector at the first preset angle to rotate to a third preset angle and controlling the rotatable pentaprism at the second preset angle to rotate to a fourth preset angle after the first control unit controls the second shooting module to shoot images; when the rotatable reflector rotates to the third preset angle and the rotatable pentaprism rotates to the fourth preset angle, the rotatable reflector and the rotatable pentaprism transmit ambient light to the first shooting module, and when the rotatable reflector rotates to the first preset angle and the rotatable pentaprism rotates to the second preset angle, the rotatable reflector and the rotatable pentaprism transmit ambient light to the second shooting module;

8. The wearable device according to claim 6 or 7, wherein the first sending unit is configured to send the image captured by the second capture module to the video terminal in a manner that:

9. The wearable device of claim 8, wherein the smart host further comprises:

10. The wearable device according to claim 6 or 7, wherein the first sending unit is configured to send the image captured by the second capture module to the video terminal in a manner that: