CN116095461A

CN116095461A - Video recording method and related device

Info

Publication number: CN116095461A
Application number: CN202210577626.3A
Authority: CN
Inventors: 黄雨菲; 易婕
Original assignee: Honor Device Co Ltd
Current assignee: Honor Device Co Ltd
Priority date: 2022-05-25
Filing date: 2022-05-25
Publication date: 2023-05-09

Abstract

The embodiment of the application provides a video recording method and a related device. The method comprises the following steps: displaying a first interface, wherein the first interface comprises a first window and a second window; the first window displays a picture acquired by the first camera in real time, the picture comprises a first object, and the second window displays a part of pictures related to the first object in the first window; detecting that a first object is displayed at a first position of a first window at a first moment, and displaying a part of pictures related to the first object in the first window by a second window; the first object is displayed at a second position of the first window detected at a second moment, and the second window displays a part of pictures related to the first object in the first window. Therefore, after the first object tracking target is set, the terminal equipment can additionally obtain and display the picture corresponding to the first object, further additionally obtain the focus tracking video corresponding to one path of first object while recording the video, further reduce the subsequent editing operation on the tracking target, and improve the editing efficiency.

Description

Video recording method and related device

Technical Field

The application relates to the technical field of terminals, in particular to a video recording method and a related device.

Background

In order to improve user experience, electronic devices such as mobile phones and tablet computers are generally configured with multiple cameras. For example, a front camera and a rear camera are respectively disposed on the electronic device. The user can select a corresponding shooting mode, for example, a proactive mode, a post-shooting mode, a front-back double-shooting mode, and the like, according to his own needs.

In some scenarios, one or more characters are included in a video captured by a user via an electronic device. When a user wants to obtain a video of a single person, a manual editing process is required for the video.

However, the manual editing mode is complex in operation and low in efficiency, so that the user experience of the electronic equipment is poor.

Disclosure of Invention

The embodiment of the application provides a video recording method and a related device, which are applied to electronic equipment. According to the method, the selected person can be tracked to additionally generate one path of video when the video is shot, manual editing by a user is not needed, user operation is reduced, and user experience is improved.

In a first aspect, an embodiment of the present application provides a video recording method, where the method includes: the terminal equipment displays a first interface, wherein the first interface comprises a first window and a second window; the first window displays a picture acquired by the first camera in real time, the picture comprises a first object, and the second window displays a part of pictures related to the first object in the first window; at a first moment, the terminal equipment detects that a first object is displayed at a first position of a first window, and a second window displays a part of pictures which are related to the first object at the first position in the first window; at a second moment, the terminal device detects that the first object is displayed at the second position of the first window, and the second window displays a part of pictures related to the first object at the second position of the first window.

It is understood that the first interface may be a preview interface (for example, an interface shown by a in fig. 3B) provided with a tracking target, or may be a recording interface (for example, an interface shown by a in fig. 3C) provided with a tracking target. The first window may be understood as a preview area or a recording area below; the picture acquired by the first camera in real time can be understood as a preview picture or a recording picture below; the second window may be understood as a small window hereinafter; the screen displayed in the second window may be understood as a tracking screen corresponding to the tracking target.

In the embodiment of the present application, the screen (tracking screen) displayed by the second window changes with the position change of the focus tracking target. Specifically, the position of the tracking object in the screen displayed in the second window changes and changes, and fig. 3B or 3C may be referred to. For example, the interface at the first time may be the interface shown by a in fig. 3B, and the interface at the second time may be the interface shown by B in fig. 3B; alternatively, the interface at the first time may be the interface shown as a in fig. 3C, and the interface at the second time may be the interface shown as b in fig. 3C.

In summary, the first object is a tracking target, and after the terminal device sets the tracking target, the terminal device can additionally obtain and display a picture corresponding to the tracking target, so that one or more paths of tracking targets are additionally obtained while video is recorded, further, subsequent editing operation on the tracking target is reduced, and editing efficiency is improved.

Optionally, the first window includes a first switching control, and/or the second window includes a second switching control; the method further comprises the steps of: at a third moment, when the second window is in a horizontal screen display state, responding to the triggering operation of the first switching control or the second switching control, and switching the second window into a vertical screen display state by the terminal equipment; or when the second window is in the vertical screen display state at the third moment, responding to the triggering operation of the first switching control or the second switching control, and switching the second window into the horizontal screen display state by the terminal equipment.

In this embodiment, when the first switching control and the second switching control are triggered, the small window style may be switched from horizontal to vertical or from vertical to horizontal. The landscape display state can be understood as a landscape display hereinafter; the landscape display state can be understood as a vertical display hereinafter.

The triggering operation of the first switching control or the second switching control may be a clicking operation, a touch operation, or other operations, which are not limited herein.

The form of the first switch control, the second switch control, etc. may be referred to in the following description. The manner in which the first switch control and the second switch control are triggered and the switching schematic can be described with reference to fig. 13A and 13B, which are not limited herein.

Therefore, the terminal equipment can adjust the style of the small window, so that the small window can be conveniently adjusted by a user, and the user experience is improved.

Optionally, the method further comprises: when the second window is switched from the horizontal screen display state to the vertical screen display state, the terminal equipment controls the second window to extend along a first preset direction and shorten along a second preset direction based on the vertical switching positioning point, wherein the first preset direction is a direction parallel to the short side in the horizontal screen display state, and the second preset direction is a direction perpendicular to the short side in the horizontal screen display state.

In the embodiment of the present application, the vertical switching positioning point may be an upper left corner of the small window, or may be a lower left corner of the small window, or may be an upper right corner of the small window, or a lower right corner of the small window, which is not limited herein; the first preset direction may be vertically upward or vertically downward, which is not limited herein. The second preset direction may be horizontal left or horizontal right, which is not limited herein.

For example, when the vertical switch anchor point is the lower left corner of the widget, the widget switch may be as shown in fig. 14A, 14B.

In this way, the terminal device can control the small window to switch from the horizontal direction to the vertical direction based on the preset direction.

Optionally, the first preset direction is vertical upwards, the second preset direction is horizontal leftwards, and the vertical switching positioning point is a left lower corner vertex of the second window; the terminal equipment controls the second window to extend along the first preset direction and shorten along the second preset direction based on the vertical switching positioning point, and the terminal equipment comprises: when the first distance is smaller than or equal to the second distance, the terminal equipment controls the position of the left lower corner vertex of the second window to be unchanged, controls the second window to vertically extend upwards and horizontally shorten leftwards, and the first distance is the length of the long side of the second window, and the second distance is the distance between the left lower corner vertex of the second window and the upper edge of the first window; or when the first distance is larger than the second distance, the terminal equipment controls the position of the top point of the lower left corner of the second window to be unchanged, controls the second window to vertically extend upwards, and when the upper edge of the second window intersects with the upper edge of the first window, controls the second window to vertically extend downwards.

Therefore, when the small window is prolonged to the edge of the preview area, the terminal equipment can change the prolonged direction of the small window, further reduce the incomplete display caused by the fact that the small window exceeds the preview area, and increase user experience.

Optionally, the terminal device is preset with a plurality of vertical switching positioning points, and the method further includes: when the first distance is smaller than or equal to the distance between the first vertical switching positioning point and the edge of the first window in the corresponding extending direction, the terminal equipment controls the second window to extend along a first preset direction corresponding to the first vertical switching positioning point based on the first vertical switching positioning point and shorten along a second preset direction, wherein the first vertical switching positioning point is any one of a plurality of vertical switching positioning points, and the first distance is the length of a long side of the second window;

when the first distance is greater than the distance between each vertical switching positioning point and the edge of the first window in the corresponding extending direction, the terminal equipment controls the second window to extend along the first preset direction corresponding to the second vertical switching positioning point based on the second vertical switching positioning point, shortens along the second preset direction, and the second vertical switching positioning point is any one of the vertical switching positioning points.

For example, when the vertical switch anchor point is the lower left corner of the widget, the widget switch may be as shown in fig. 14C, 14D, 14E.

It can be appreciated that the terminal device may determine the selected vertical positioning point based on the position of the widget, and then determine the extension direction of the widget. The terminal device can select the extension direction of the small window, and preferably selects a mode without changing the extension direction. Therefore, the change of the extending direction in the small window switching process can be reduced, and the user experience is improved. In addition, when the small window is prolonged to the edge of the preview area, the terminal equipment can change the prolonged direction of the small window, so that the situation that the small window exceeds the preview area to cause incomplete display is reduced, and the user experience is improved.

Optionally, the vertical switching positioning point includes a lower left corner vertex of the second window and an upper left corner vertex of the second window; the first preset direction corresponding to the left lower corner vertex of the second window is vertical upwards, the first preset direction corresponding to the left upper corner vertex of the second window is vertical downwards, and the second preset direction is a vertical switching positioning point for switching the positioning point horizontally and vertically leftwards;

when the first distance is smaller than or equal to the distance between the first vertical switching positioning point and the edge of the first window in the corresponding extending direction, the terminal equipment controls the second window to extend along a first preset direction corresponding to the first vertical switching positioning point based on the first vertical switching positioning point and shorten along a second preset direction, and the first vertical switching positioning point is any one of a plurality of vertical switching positioning points and comprises: when the first distance is smaller than or equal to the second distance, the terminal equipment controls the position of the left lower corner vertex of the second window to be unchanged, controls the second window to vertically extend upwards and horizontally shorten leftwards, and the first distance is the length of the long side of the second window, and the second distance is the distance between the left lower corner vertex of the second window and the upper edge of the first window; or when the first distance is larger than the second distance and smaller than or equal to the fourth distance, the terminal equipment controls the position of the top left corner vertex of the second window to be unchanged, controls the second window to vertically and downwards extend, and horizontally and leftwards shorten, and the fourth distance is the distance between the top left corner vertex and the lower edge of the first window;

When the first distance is greater than the distance between each vertical switching positioning point and the edge of the first window in the corresponding extending direction, the terminal equipment controls the second window to extend along the first preset direction corresponding to the second vertical switching positioning point based on the second vertical switching positioning point, shortens along the second preset direction, and the second vertical switching positioning point is any one of the vertical switching positioning points, and comprises: when the first distance is larger than the second distance and larger than the fourth distance, the terminal equipment controls the position of the top point of the lower left corner of the second window to be unchanged, controls the second window to vertically extend upwards and horizontally shorten leftwards, and when the upper edge of the second window is intersected with the upper edge of the first window, the terminal equipment controls the second window to vertically extend downwards and horizontally shorten leftwards.

It can be appreciated that the terminal device may determine the selected vertical positioning point based on the position of the widget, and then determine the extension direction of the widget. Therefore, when the small window is prolonged to the edge of the preview area, the terminal equipment can change the prolonged direction of the small window, further reduce the incomplete display caused by the fact that the small window exceeds the preview area, and increase user experience.

Optionally, the method further comprises: when the second window is switched from the vertical screen display state to the horizontal screen display state, the terminal equipment controls the second window to extend along a third preset direction and shorten along a fourth preset direction based on the horizontal switching positioning point, wherein the third preset direction is a direction parallel to the short side in the vertical screen display state, and the fourth preset direction is a direction perpendicular to the short side in the vertical screen display state.

The transverse switching positioning point can be the left upper corner of the small window, the left lower corner of the small window, the right upper corner of the small window or the right lower corner of the small window, and is not limited herein; the third preset direction may be horizontal left or horizontal right, which is not limited herein. The fourth preset direction may be vertical upward or vertical downward, which is not limited herein.

For example, when the lateral switching anchor point is the lower left corner of the widget, the widget switching may be as shown in fig. 15A, 15B, 15C.

In this way, the terminal device can control the small window to switch from vertical to horizontal based on the preset direction.

Optionally, the fourth preset direction is vertical downward, and the transverse switching positioning point includes a left lower corner vertex of the second window and a right lower corner vertex of the second window; the terminal equipment controls the second window to extend along a third preset direction and shorten along a fourth preset direction based on the transverse switching positioning point, and the method comprises the following steps: when the first distance is smaller than or equal to the third distance, the terminal equipment controls the position of the left lower corner vertex of the second window to be unchanged, controls the second window to horizontally extend to the right and vertically shorten downwards, wherein the first distance is the length of the long side of the second window, and the third distance is the distance between the left lower corner vertex of the second window and the right edge of the first window; when the first distance is larger than the third distance, the terminal equipment controls the position of the top point of the right lower angle of the second window to be unchanged, and controls the second window to horizontally extend leftwards and vertically shorten downwards.

For example, the small window switching may be as shown in fig. 15C.

It can be appreciated that the terminal device can determine the selected lateral positioning point based on the position of the widget, and then determine the extension direction of the widget. The terminal device may select the direction of the extension of the widget. In this way, the situation that the display is incomplete due to the fact that the small window exceeds the preview area can be reduced, and user experience is improved.

Optionally, the method further comprises: the terminal equipment detects the shrinking or enlarging operation aiming at the second window; in response to the reduction or enlargement operation for the second window, the terminal device reduces or enlarges the size of the second window.

The operation of reducing or enlarging the second window may be an operation of pressing the small window by two fingers and changing the distance between the two fingers, or an operation of pressing the reducing or enlarging control, which is not limited in the embodiment of the present application.

For example, when the user double-finger presses the small window and increases the double-finger distance, the terminal device detects an enlargement operation for the second window; when the user double-finger presses the small window and reduces the double-finger distance, the terminal device detects a zoom-out operation for the second window. The display and control of the terminal device in the process of small window amplification may be as shown in fig. 9, which is not described herein.

Optionally, when the terminal device zooms out or zooms in the size of the second window, the content of the second screen is unchanged, or how much of the content of the second screen is proportional to the size of the second window.

When the small window is reduced or enlarged, the content size of the second picture is reduced or enlarged accordingly; when the small window is reduced or enlarged, the content size of the second picture is reduced or increased. Reference may be made specifically to the relevant description in fig. 9, and no further description is given here.

Optionally, the terminal device reduces or enlarges the size of the second window, including: when the terminal device enlarges the size of the second window and the second window intersects with the edge of the first window in the enlarging direction, the terminal device changes the enlarging direction of the second window.

Therefore, the terminal equipment can change the amplifying direction of the small window, and further the situation that the display of the small window is incomplete due to the fact that the small window exceeds the preview area in the amplifying process can be reduced.

Optionally, in the process of amplifying the size of the second window by the terminal device, if the second window intersects with the edge of the first window in the amplifying direction corresponding to the mth positioning point, the terminal device determines an mth+1th positioning point, where the mth+1th positioning point is located at an edge of the second window intersecting with the first window in the amplifying direction and is adjacent to the mth positioning point, and the amplifying direction corresponding to the mth positioning point is a diagonal direction of the mth positioning point; the terminal equipment controls the position of the M+1th positioning point to be unchanged, and amplifies the second window along the amplifying direction corresponding to the M+1th positioning point, wherein the amplifying direction corresponding to the M+1th positioning point is the diagonal direction of the M+1th positioning point.

It can be understood that the terminal device can determine the next positioning point based on the last positioning point, further determine the adjusted amplifying direction, and reduce the number of times of changing the adjusting direction of the small window.

Illustratively, the Mth anchor point is the lower left corner vertex; when the upper edge of the second window is intersected with the upper edge of the first window, the terminal equipment controls and determines that an M+1th positioning point is an upper left corner vertex; the terminal equipment controls the position of the vertex of the upper left corner of the second window to be unchanged, and enlarges the second window along the direction of the lower right corner; or when the right edge of the second window is intersected with the right edge of the first window, the terminal equipment controls and determines that the (M+1) th positioning point is the right lower corner vertex; the terminal equipment controls the position of the top point of the right lower corner of the second window to be unchanged, and enlarges the second window along the direction of the left upper corner.

It will be appreciated that the process of enlarging the small window may refer to the following description of fig. 11C, which is not repeated here.

Therefore, when the edge of the small window is intersected with the edge of the preview area, the terminal equipment can switch the direction of amplifying and extending the small window, so that the situation that the small window exceeds the preview area in the amplifying process is reduced, and the phenomenon that the small window is not completely displayed is reduced. In addition, the preset corner of the small window is adjusted based on the intersection point, and the change times of the adjustment direction of the small window can be reduced.

Optionally, when the terminal device enlarges the size of the second window and the second window intersects with the edge of the first window in the enlarging direction, the terminal device determines the enlarging direction of the replaced second window based on the edge of the second window intersecting with the first window in the enlarging direction, including: when the terminal equipment enlarges the size of the second window, the terminal equipment controls the vertex of the lower left corner of the second window to be unchanged, and enlarges the second window along the direction of the upper right corner; when the upper edge of the second window is intersected with the upper edge of the first window, the terminal equipment controls the vertex of the upper left corner of the second window to be unchanged, and the second window is enlarged along the direction of the lower right corner; when the right edge of the second window is intersected with the right edge of the first window, the terminal device controls the vertex of the upper right corner of the second window to be unchanged, and enlarges the second window along the lower left corner direction.

Optionally, the method further comprises: the terminal equipment detects a moving operation aiming at a second window; in response to the movement operation for the second window, the terminal device moves the second window along the movement locus of the movement operation.

The moving operation of the second window may be a drag operation or other operations, which is not limited in the embodiment of the present application.

For example, the display and control of the terminal device during the movement of the widget may be as shown in fig. 8, which is not described herein.

Thus, the position of the small window can be adjusted, and the user experience is improved.

Optionally, when the terminal device displays the first interface, a focal point focused by the first camera is on the first object; at a first moment, a focal point of the first camera is focused on a first object; at a second moment, the focal point of the first camera is on the first object.

In a second aspect, embodiments of the present application provide a terminal device, which may also be referred to as a terminal (terminal), a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), or the like. The terminal device may be a mobile phone, a smart television, a wearable device, a tablet (Pad), a computer with wireless transceiving function, a Virtual Reality (VR) terminal device, an augmented reality (augmented reality, AR) terminal device, a wireless terminal in industrial control (industrial control), a wireless terminal in unmanned driving (self-driving), a wireless terminal in teleoperation (remote medical surgery), a wireless terminal in smart grid (smart grid), a wireless terminal in transportation safety (transportation safety), a wireless terminal in smart city (smart city), a wireless terminal in smart home (smart home), or the like.

The terminal device comprises a processor for invoking a computer program in memory to perform the method as in the first aspect.

In a third aspect, embodiments of the present application provide a computer-readable storage medium storing computer instructions that, when run on a terminal device, cause the terminal device to perform a method as in the first aspect.

In a fourth aspect, embodiments of the present application provide a computer program product for causing a terminal device to carry out the method as in the first aspect when the computer program is run.

In a fifth aspect, embodiments of the present application provide a chip comprising a processor for invoking a computer program in a memory to perform a method as in the first aspect.

It should be understood that, the second aspect to the fifth aspect of the present application correspond to the technical solutions of the first aspect of the present application, and the beneficial effects obtained by each aspect and the corresponding possible embodiments are similar, and are not repeated.

Drawings

Fig. 1 is a schematic diagram of a hardware system structure of a terminal device provided in an embodiment of the present application;

fig. 2 is a schematic diagram of a software system structure of a terminal device according to an embodiment of the present application;

Fig. 3A is a schematic view of an application scenario provided in an embodiment of the present application;

FIG. 3B is a schematic view of a main angle mode preview interface according to an embodiment of the present disclosure;

fig. 3C is a schematic diagram of a main angle mode recording interface according to an embodiment of the present application;

fig. 4 is an interface schematic diagram of a terminal device entering a main angle mode according to an embodiment of the present application;

fig. 5 is an interface schematic diagram of a terminal device entering a main angle mode according to an embodiment of the present application;

fig. 6 is an interface schematic diagram corresponding to a main angle mode recording flow provided in an embodiment of the present application;

fig. 7 is an interface schematic diagram corresponding to a main angle mode recording flow provided in an embodiment of the present application;

FIG. 8 is a schematic diagram of an interface for movement of a widget according to an embodiment of the present disclosure;

FIG. 9 is an enlarged view of an interface of a small window according to an embodiment of the present disclosure;

fig. 10 is a schematic structural diagram of a terminal device interface layout provided in an embodiment of the present application;

FIG. 11A is an enlarged layout view of a small window according to an embodiment of the present disclosure;

FIG. 11B is an enlarged layout view of a small window according to an embodiment of the present disclosure;

FIG. 11C is a schematic diagram of a layout of a small window with enlarged size according to an embodiment of the present application

Fig. 12 is an enlarged layout schematic diagram of a small window according to an embodiment of the present application;

fig. 13A is an interface schematic diagram of a small window style switching according to an embodiment of the present application;

fig. 13B is an interface schematic diagram of a small window style switching according to an embodiment of the present application;

fig. 14A is a layout diagram of a small window style switching according to an embodiment of the present application;

fig. 14B is a layout diagram of a small window style switching according to an embodiment of the present application;

fig. 14C is a layout diagram of a small window style switching according to an embodiment of the present application;

fig. 14D is a layout diagram of a small window style switching according to an embodiment of the present application;

fig. 14E is a layout diagram of a small window style switching according to an embodiment of the present application;

fig. 15A is a layout schematic diagram of a small window style switching according to an embodiment of the present application;

fig. 15B is a layout diagram of a small window style switching according to an embodiment of the present application;

fig. 15C is a layout diagram of a small window style switching according to an embodiment of the present application;

fig. 16 is an interface schematic diagram of a widget style switching according to an embodiment of the present disclosure;

FIG. 17 is a schematic flow chart of a video recording method according to an embodiment of the present application;

Fig. 18 is a schematic structural diagram of a video recording apparatus according to an embodiment of the present application.

Detailed Description

In order to clearly describe the technical solutions of the embodiments of the present application, in the embodiments of the present application, the words "first", "second", etc. are used to distinguish the same item or similar items having substantially the same function and effect. For example, the first chip and the second chip are merely for distinguishing different chips, and the order of the different chips is not limited. It will be appreciated by those of skill in the art that the words "first," "second," and the like do not limit the amount and order of execution, and that the words "first," "second," and the like do not necessarily differ.

It should be noted that, in the embodiments of the present application, words such as "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "for example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present related concepts in a concrete fashion.

In the embodiments of the present application, "at least one" means one or more, and "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a alone, a and B together, and B alone, wherein a, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b, or c may represent: a, b, c, a-b, a-c, b-c, or a-b-c, wherein a, b, c may be single or plural.

The embodiment of the application provides a video recording method which can be applied to electronic equipment with a shooting function. The electronic device includes a terminal device, which may also be referred to as a terminal (terminal), a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), or the like. The terminal device may be a mobile phone, a smart television, a wearable device, a tablet (Pad), a computer with wireless transceiving function, a Virtual Reality (VR) terminal device, an augmented reality (augmented reality, AR) terminal device, a wireless terminal in industrial control (industrial control), a wireless terminal in unmanned driving (self-driving), a wireless terminal in teleoperation (remote medical surgery), a wireless terminal in smart grid (smart grid), a wireless terminal in transportation safety (transportation safety), a wireless terminal in smart city (smart city), a wireless terminal in smart home (smart home), or the like. The embodiment of the application does not limit the specific technology and the specific equipment form adopted by the terminal equipment.

In order to better understand the embodiments of the present application, the following describes the structure of the terminal device in the embodiments of the present application:

Fig. 1 shows a schematic structure of a terminal device 100. The terminal device may include: radio Frequency (RF) circuitry 110, memory 120, input unit 130, display unit 140, sensor 150, audio circuitry 160, wireless fidelity (wireless fidelity, wiFi) module 170, processor 180, power supply 190, and bluetooth module 1100. It will be appreciated by those skilled in the art that the terminal device structure shown in fig. 1 is not limiting of the terminal device and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.

The following describes the respective constituent elements of the terminal device in detail with reference to fig. 1:

the RF circuit 110 may be used for receiving and transmitting signals during the process of receiving and transmitting information or communication, specifically, after receiving downlink information of the base station, the downlink information is processed by the processor 180; in addition, the data of the design uplink is sent to the base station. Typically, RF circuitry includes, but is not limited to, antennas, at least one amplifier, transceivers, couplers, low noise amplifiers (low noise amplifier, LNAs), diplexers, and the like. In addition, RF circuit 110 may also communicate with networks and other devices via wireless communications. The wireless communications may use any communication standard or protocol including, but not limited to, global system for mobile communications (global system of mobile communication, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), long term evolution (long term evolution, LTE), email, and short message service (short messaging service, SMS), among others.

The memory 120 may be used to store software programs and modules, and the processor 180 performs various functional applications and data processing of the terminal device by running the software programs and modules stored in the memory 120. The memory 120 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, a boot loader (boot loader), etc.; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the terminal device, and the like. In addition, memory 120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. It will be appreciated that in the embodiment of the present application, the memory 120 stores a program for connecting back to the bluetooth device.

The input unit 130 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the terminal device. In particular, the input unit 130 may include a touch panel 131 and other input devices 132. The touch panel 131, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 131 or thereabout by using any suitable object or accessory such as a finger, a stylus, etc.), and drive the corresponding connection device according to a predetermined program. Alternatively, the touch panel 131 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into touch point coordinates, which are then sent to the processor 180, and can receive commands from the processor 180 and execute them. In addition, the touch panel 131 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The input unit 130 may include other input devices 132 in addition to the touch panel 131. In particular, other input devices 132 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, mouse, joystick, etc.

The display unit 140 may be used to display information input by a user or information provided to the user and various menus of the terminal device. The display unit 140 may include a display panel 141, and alternatively, the display panel 141 may be configured in the form of a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), or the like. Further, the touch panel 131 may cover the display panel 141, and when the touch panel 131 detects a touch operation thereon or thereabout, the touch panel is transferred to the processor 180 to determine the type of the touch event, and then the processor 180 provides a corresponding visual output on the display panel 141 according to the type of the touch event. Although in fig. 1, the touch panel 131 and the display panel 141 implement input and output functions of the terminal device as two independent components, in some embodiments, the touch panel 131 and the display panel 141 may be integrated to implement input and output functions of the terminal device.

The terminal device may also include at least one sensor 150, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor that may adjust the brightness of the display panel 141 according to the brightness of ambient light, and a proximity sensor that may turn off the display panel 141 or the backlight when the terminal device moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for recognizing the gesture of the terminal equipment (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that may also be configured for the terminal device are not described in detail herein.

Audio circuitry 160, speaker 161, microphone 162 may provide an audio interface between the user and the terminal device. The audio circuit 160 may transmit the received electrical signal converted from audio data to the speaker 161, and the electrical signal is converted into a sound signal by the speaker 161 to be output; on the other hand, the microphone 162 converts the collected sound signal into an electrical signal, receives the electrical signal from the audio circuit 160, converts the electrical signal into audio data, outputs the audio data to the processor 180 for processing, transmits the audio data to, for example, another terminal device via the RF circuit 110, or outputs the audio data to the memory 120 for further processing.

WiFi belongs to a short-distance wireless transmission technology, and terminal equipment can help a user to send and receive emails, browse webpages, access streaming media and the like through a WiFi module 170, so that wireless broadband Internet access is provided for the user. Although fig. 1 shows a WiFi module 170, it is understood that it does not belong to the essential constitution of the terminal device, and can be omitted entirely as required within the scope of not changing the essence of the invention.

The processor 180 is a control center of the terminal device, connects various parts of the entire terminal device using various interfaces and lines, and performs various functions of the terminal device and processes data by running or executing software programs or modules stored in the memory 120 and calling data stored in the memory 120, thereby performing overall monitoring of the terminal device. Optionally, the processor 180 may include one or more processing units; preferably, the processor 180 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 180.

It will be appreciated that in the embodiment of the present application, the memory 120 stores a program of video recording, and the processor 180 may be configured to call and execute the program of video recording stored in the memory 120 to implement the method of video recording in the embodiment of the present application.

The terminal device further includes a power supply 190 (e.g., a battery) for powering the various components, which may be logically connected to the processor 180 via a power management system so as to provide for managing charging, discharging, and power consumption by the power management system.

The bluetooth technology belongs to a short-distance wireless transmission technology, and the terminal device can establish bluetooth connection with other terminal devices with bluetooth modules through the bluetooth module 1100, so that data transmission is performed based on a bluetooth communication link. Bluetooth module 1100 may be a bluetooth low energy (bluetooth low energy, BLE), or module, as desired. It can be understood that, in the embodiment of the present application, in the case that the terminal device is a user terminal and a service tool, the terminal device includes a bluetooth module. It will be understood that the bluetooth module does not belong to the essential constitution of the terminal device, and may be omitted entirely as required within the scope of not changing the essence of the invention, for example, the bluetooth module may not be included in the server.

Although not shown, the terminal device further includes a camera. Optionally, the position of the camera on the terminal device may be front, rear, or internal (which may extend out of the body when in use), which is not limited in this embodiment of the present application.

Alternatively, the terminal device may include a single camera, a dual camera, or a triple camera, which is not limited in the embodiments of the present application. Cameras include, but are not limited to, wide angle cameras, tele cameras, depth cameras, and the like. For example, the terminal device may include three cameras, one of which is a main camera, one of which is a wide-angle camera, and one of which is a tele camera.

Alternatively, when the terminal device includes a plurality of cameras, the plurality of cameras may be all front-mounted, all rear-mounted, all built-in, at least part of front-mounted, at least part of rear-mounted, at least part of built-in, or the like, which is not limited in the embodiment of the present application.

Fig. 2 is a block diagram illustrating a software configuration of the terminal device 100 according to the embodiment of the present application.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages. As shown in fig. 2, the application package may include camera, gallery, phone, map, phone, music, settings, mailbox, video, social, etc. applications.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 2, the application framework layer may include a window manager, a content provider, a resource manager, a view system, a notification manager, and the like.

The window manager is used for managing window programs. The window manager may obtain the display screen size, determine if there is a status bar, lock the screen, touch the screen, drag the screen, intercept the screen, etc.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the terminal equipment vibrates, and an indicator light blinks.

Android runtimes include core libraries and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The workflow of terminal equipment software and hardware is illustrated below in connection with the scenario of terminal equipment interface switching.

When a touch sensor in the terminal equipment receives touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into the original input event (including information such as touch coordinates, touch strength, time stamp of the touch operation, etc.). The original input event is stored at the kernel layer. The application framework layer acquires an original input event from the kernel layer, and identifies a control corresponding to the input event. Taking the touch operation as a touch click operation, taking a control corresponding to the click operation as an example of a control of a camera application icon, calling an interface of an application framework layer by the camera application, starting the camera application, and further starting a display driver by calling a kernel layer to display a functional interface of the camera application.

When the camera application is started, the camera application can call a camera access interface in an application program framework layer, start a shooting function of a camera, and drive one or more cameras to acquire one or more frames of images in real time based on camera driving of a kernel layer. After the camera acquires the image, the image can be transmitted to the camera application in real time through the kernel layer, the system library and the application program framework layer, and then the camera application displays the image to a corresponding functional interface.

The following describes the technical solutions of the present application and how the technical solutions of the present application solve the above technical problems in detail with specific embodiments. The following embodiments may be implemented independently or combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments.

In order to improve user experience, terminal devices such as mobile phones and tablet computers are generally configured with a plurality of cameras. The terminal device may provide a plurality of photographing modes, such as a front photographing mode, a rear photographing mode, a front and rear double photographing mode, a main angle mode, etc., for the user through the plurality of cameras configured. The user can select a corresponding shooting mode to shoot according to the shooting scene.

The principal angle mode can be understood as a mode that when the terminal equipment records the video, a portrait focus-tracking video can be additionally generated, namely, more than two videos are saved when the recording is completed, one of the videos is a recorded original video, and other videos are videos automatically cut from the original video according to the tracked target portrait. The person image in the person image focus tracking video can be understood as a "principal angle" focused by a user, and the manner of generating the video corresponding to the "principal angle" can be as follows: and cutting out video content corresponding to the main angle from the video conventionally recorded by the terminal equipment.

The "principal angle" may be a living body such as a person or an animal, or may be a non-living body such as a vehicle. It is understood that any item that can be identified based on an algorithmic model can be used as the "principal angle" in embodiments of the present application. In the embodiment of the present application, the "principal angle" may be defined as a focus tracking object, and the focus tracking object may also be referred to as a principal angle object, a tracking target, a tracking object, a focus tracking target, etc., which is not limited by the concept of the "principal angle".

For convenience of understanding, a main angle mode among photographing modes is described below with reference to the accompanying drawings.

Fig. 3A is a schematic view of an application scenario provided in an embodiment of the present application. As shown in fig. 3A, a terminal device 301, a person 302, and a person 303 are included in the application scene.

The terminal device 301 may record a video containing the tracking target through a camera. The tracking target can be any person recorded by a camera, or any object such as an animal, a car and the like. In the scene shown in fig. 3A, the tracking target may be the person 302 in the photographed image or the person 303 in the photographed image.

In the principal angle mode, the terminal equipment can additionally obtain one or more tracking target corresponding focus tracking videos while recording the videos.

Specifically, when the terminal device 301 previews in the principal angle mode, the terminal device 301 may receive an operation of setting a tracking target by the user, and after the terminal device 301 starts recording the video, one or more additional tracking videos may be generated based on the tracking target. The terminal device 301 may set the person 302 in the photographed screen as the tracking target, or may set the person 303 in the photographed screen as the tracking target, for example.

Alternatively, when the terminal device 301 records in the main angle mode, the terminal device 301 may additionally generate one or more tracking videos based on the tracking target, upon receiving an operation of setting the tracking target by the user. Thus, the focus tracking video corresponding to the tracking target can be obtained without manually editing the whole video.

It can be understood that the terminal device can switch the person corresponding to the tracking target one or more times during the video recording process. Specifically, when the terminal device receives the operation of switching the tracking target by the user, the terminal device switches the person corresponding to the tracking target.

In one possible implementation, when the person corresponding to the tracking target is switched, different persons exist in the focus tracking video obtained by the terminal device.

Illustratively, when the terminal device detects that the user switches the tracking target from person 302 to person 303 during recording, the terminal device displays a tracking screen based on person 303. In a focus tracking video generated based on a tracking target after recording is finished, displaying a character 302 correspondingly before the tracking target is switched; displaying the character 303 correspondingly after the tracking target is switched; it can also be understood that the portion before the tracking target is switched corresponds to the person 302, and the portion after the tracking target is switched corresponds to the person 303.

Specifically, taking the 3 rd second in the recording process of the focus tracking video, the terminal device detects that the user switches the tracking target from the person 302 to the person 303 as an example. In the focus tracking video generated based on the tracking target, the person 302 is correspondingly displayed in the focus tracking video before the 3 rd second; the person 303 is displayed in correspondence with the focus tracking video after the 3 rd second. Therefore, the terminal equipment can switch the tracking target, so that the switching of the characters in the focus tracking video is realized, and the user experience is improved.

In another possible implementation, when the person corresponding to the tracking target is switched, the terminal device may obtain one path of the focus tracking video based on the tracking target before switching, and obtain the other path of the focus tracking video based on the tracking target after switching.

Illustratively, when the terminal device detects that the user switches the tracking target from the person 302 to the person 303 during recording, the terminal device generates the focus tracking video 1 based on the person 302, and generates the focus tracking video 2 based on the person 303 after the tracking target is switched to the person 303.

In some embodiments, in the recording process of the video, the terminal device may also start and end recording of the focus tracking video multiple times, and additionally generate multiple paths of focus tracking videos.

Illustratively, in recording video 1, when the terminal device receives an operation that the user ends tracking person 303, the terminal device may generate a focus tracking video 2 based on the person 303. When the terminal device receives the operation of the user tracking the person 302 after finishing the operation of tracking the person 303, the terminal device 301 may additionally generate the focus tracking video 3 based on the person 302. At this time, in addition to the normally recorded video 1, the terminal device additionally generates 2 chasing videos (i.e., chasing video 2 and chasing video 3). The embodiment of the application does not limit the number of the focus tracking videos.

Therefore, the terminal equipment can start and end recording of the focus tracking video for a plurality of times, generate a plurality of paths of focus tracking videos based on the tracking target, and improve user experience.

It should be noted that, in the scene shown in fig. 3A, the video recorded by the terminal device through the camera includes two characters. More or fewer characters may be included in the video of the terminal device. The number of characters recorded by the terminal equipment is not particularly limited.

It should be noted that, when the terminal device previews and records in the main angle mode, the operation of setting the tracking target by the user is not received, and when the recording is finished, a path of video can be obtained. When the terminal equipment receives the operation of setting the tracking target by the user through the main angle mode preview and then receives the operation of closing the small window by the user, the terminal equipment cancels the tracking of the tracking target, if the operation of setting the tracking target by the user is not received during recording, and when the recording is finished, one path of video can be obtained. It is understood that the principal angle mode may be provided in an application having a photographing function such as a camera. After the terminal device enters the main angle mode, the implementation of the main angle mode may include a preview mode and a recording mode.

It should be noted that, the interface displayed by the terminal device in the preview mode (before recording) and the recording mode (during recording) may be referred to as a preview interface; the pictures displayed in the preview interface of the preview mode (before recording) are not generated and saved; the pictures displayed in the preview interface of the recording mode (during recording) can be generated and saved. For convenience of distinction, hereinafter, a preview interface of a preview mode (before recording) is referred to as a preview interface; the preview interface of the recording mode (during recording) is referred to as a recording interface.

In the preview mode of the home angle mode, an image (preview screen) obtained by the camera may be displayed in the preview area, and an image (trace screen) of the trace target selected by the user may be displayed in the small window. In the preview mode, the terminal device may not generate a video, or may not store the content displayed in the preview area and the content displayed in the small window.

For example, a preview interface of the principal angle mode in the terminal device may be as shown in fig. 3B. The preview interface includes a preview area 304, a recording control 305.

The preview area 304 displays a preview screen. When the terminal device recognizes that a person is included in the preview screen, a tracking frame (e.g., tracking frame 307 and tracking frame 308) is displayed in the preview area. The tracking frame can prompt the user that the corresponding person can be set or switched to the tracking target, and the user can conveniently set or switch the tracking target. When the terminal device recognizes that a plurality of persons are included in the preview screen, the preview area may be displayed with a plurality of tracking frames. The number of tracking frames is less than or equal to the number of people identified by the terminal device. The tracking target is any one of a plurality of persons corresponding to the tracking frame in the preview screen. The tracking target may be referred to as a focus tracking object, a principal angle object, or the like, which is not limited in the present application.

In some embodiments, the tracking box (e.g., tracking box 307) corresponding to the person set to track the target is different from the tracking box display style corresponding to the person not set to track the target (e.g., tracking box 308). In this way, the user can distinguish and identify the tracked person (tracked target) conveniently. In addition to the different patterns of the tracking frames, the embodiments of the present application may also set the colors of the tracking frames, for example, the colors of the tracking frame 307 and the tracking frame 308 are different. Thus, the tracking target can be intuitively distinguished from other people.

The trace box may be a virtual box, such as trace box 307; the combination of the virtual box and "+" is also possible, such as the tracking box 308, which may be any display form, and the tracking box may be satisfied by a function that can be triggered by a user to implement tracking and may be set as a tracking target. The tracking frame may be marked at any location of a person that may be set to track a target, as embodiments of the present application are not particularly limited.

It can be understood that the tracking frame is one of the tracking identifiers, and the terminal device can also display other forms of tracking identifiers, so as to facilitate the user to set the tracking target. By way of example, other forms of tracking identification may be thumbnails of objects, numbers, letters, graphics, and the like. The tracking mark may be provided at any position of the object, may be provided near the object, or may be provided at the edge of the preview area. The embodiment of the application does not specifically limit the specific location of the tracking identifier.

For example, the terminal device may display a thumbnail arrangement of one or more objects at an edge of the preview area, and when the terminal device receives an operation that the user clicks any tracking identifier, set the object corresponding to the clicked tracking identifier as a tracking target.

In a possible implementation manner, the terminal device may identify the person through face recognition technology and display the tracking frame. The terminal device may determine the display position of the tracking frame, for example, a position where the body of the person is relatively centered, according to a technique such as human body recognition. Therefore, based on the position of the human body calculation tracking frame, the situation that the tracking frame is located at the position of the human face can be reduced, shielding of the tracking frame to the human face can be reduced, and user experience is improved. The technology used for the identification technology of the person and the tracking frame position calculation in the embodiment of the present application is not particularly limited.

In some embodiments, fig. 3B also includes a widget 306. The widget 306 displays a tracking screen. The tracking screen corresponds to a tracking target. When the tracking target is switched, the person in the tracking screen displayed in the widget 306 is switched. For example, if the tracking target is switched from the person corresponding to the tracking frame 307 to the person corresponding to the tracking frame 308, the tracking screen displayed in the widget 306 is changed accordingly.

The tracking screen may be part of a preview screen. In a possible implementation manner, the tracking picture is obtained by the terminal device cutting the preview picture according to a certain proportion based on the tracking target. The embodiment of the application does not specifically limit the frame displayed by the small window.

In some embodiments, the specification, position, horizontal and vertical screen display modes and the like of the small window are adjustable, and a user can adjust the style of the small window according to video habits.

Optionally, the tracking target is centrally displayed in the tracking screen.

Optionally, the small window floats above the recording area. And are not limited herein.

In some embodiments, widget 306 further includes a close control 309 and a first switch control 310.

It can be understood that, when the terminal device receives the operation of setting the tracking target by the user, a small window is displayed on the preview interface to display the tracking screen of the tracking target. And when the terminal equipment does not receive the operation of setting the tracking target by the user, the preview interface does not display a small window.

When the user triggers the close control 309 through clicking, touching, or other operations in the preview interface shown in fig. 3B, the terminal device receives the operation of closing the widget, closes the widget, and cancels the preview of the tracking target.

When the user triggers the first switching control 310 through clicking, touching, or other operations in the preview interface shown in fig. 3B, the terminal device receives an operation of switching the widget display mode (widget style), and the terminal device switches the style of the widget. In particular, the porthole may be switched from landscape to portrait or vice versa.

When the user triggers the recording control 305 through clicking, touching or other operations on the preview interface shown in fig. 3B, the terminal device receives an operation of starting recording, and starts recording video and tracking video.

Optionally, the preview interface may also include other controls, such as a main angle mode exit control 311, a setup control 312, a flash control 313, a widget style control 314, a zoom control 315, and the like.

When the main angle mode exit control 311 is triggered, the terminal device exits the main angle mode and enters the video recording mode. When the setting control 312 is triggered, the terminal device may adjust various setting parameters. The setting parameters include, but are not limited to: whether to turn on a watermark, store a path, a coding scheme, whether to save a geographic location, etc. When the flash control 313 is triggered, the terminal device may set a flash effect, for example, control the flash to be forcibly turned on, forcibly turned off, turned on at photographing, turned on according to environmental adaptation, and the like. When the zoom control 315 is triggered, the terminal device may adjust the focal length of the camera, thereby adjusting the magnification of the preview screen.

When the user triggers the second switching control 314 through clicking or touching on the preview interface shown in fig. 3B, the terminal device receives the operation of setting the widget style, and displays the widget style selection item for the user to select. The widget style selections include, but are not limited to: transverse or vertical, etc. The embodiments of the present application are not limited in this regard. In a possible implementation, the second switching control 314 corresponds to a display style of the widget, so that the user can distinguish the widget style conveniently.

It should be noted that, in the preview interface shown in fig. 3B, the widget style switching may be controlled by the first switching control 310, and the widget style switching may also be controlled by the second switching control 314. In a possible implementation, the first switch control 310 in the widget may be set in linkage with the second switch control 314 of the preview area. For example, when the widget is changed from landscape to portrait, the icon of the first switch control 310 is in the portrait preview style, and the icon of the second switch control 314 is also in the portrait preview style, or the icons of the first switch control 310 and the second switch control 314 are both in the landscape preview style, the user is prompted to click the preview style after the switch again.

It can be appreciated that in the preview scenario, after the terminal device sets the tracking target, the tracking screen of the widget may display the tracking target centrally. In some scenarios, the tracking target may be in a moving state, and when the tracking target moves but does not leave the lens, the tracking screen of the widget may continuously display the tracking target centrally.

For example, the preview interface may be configured such that the tracking target object includes a male character and a female character, and the terminal device sets the male character as a tracking target in response to a click operation of a tracking frame for the male character by the user, and enters the interface as shown in a in fig. 3B. In the interface shown in a in fig. 3B, the tracking screen of the small window displays a male character centered on the right side of the female character. The male character moves, and the terminal device can continuously focus on the male character and display the male character in the small window in a centered manner. When the male character walks to the left of the female character, the interface of the terminal device may be as shown in B of fig. 3B. In the B interface in fig. 3B, the tracking screen of the small window still displays a male character centered on the left side of the female character.

In a possible implementation manner, when the terminal device tracks the target, the focus moves along with the movement of the tracked target, and illustratively, in the interface shown as a in fig. 3B, the focus is located in the face area of the male character and is located in the middle right part of the screen; the male character moves, the terminal device can continue to focus on the male character, and when the male character walks to the left of the female character, the interface of the terminal device can be as shown in B of fig. 3B. In the interface shown in B in fig. 3B, the focus is located in the face region of the male character, in the middle left portion of the screen.

In the recording mode of the main angle mode, the terminal device can display an image (recording picture) obtained by the camera in a recording area, display an image (tracking picture) of a tracking target selected by a user in a small window, and generate a recording video and a focus tracking video which are recorded after the recording mode is started. And at the end of recording, the terminal equipment stores the video generated based on the recorded picture and the focus tracking video generated based on the tracking picture.

In some embodiments, the window may end the recording in advance compared to the recording of the recording area. And when the small window recording is finished, the terminal equipment stores the tracking video generated based on the tracking picture. Or it is understood that the terminal device may end the recording of the focus-following video in advance compared to the whole video.

In some embodiments, the small window may delay the start of recording compared to the recording of the recording area. Or it can be understood that after the terminal device starts to record the video, the terminal device starts to open a small window and starts to record the focus tracking video after detecting the operation of setting the tracking target by the user.

For example, the recording interface of the main angle mode in the terminal device may be as shown in fig. 3C. The recording interface includes a recording area 316, a pause control 317, and an end control 318.

Recording area 316 displays a recording picture and a recording duration. When the terminal device recognizes that a person is included in the recording screen, the recording area displays tracking frames (e.g., tracking frame 320 and tracking frame 321). It will be appreciated that the number of tracking frames is less than or equal to the number of people identified by the terminal device.

In some embodiments, the recording interface also displays a widget 319. The widget 319 displays a tracking screen. The tracking screen corresponds to a tracking target. When the tracking target is switched, the person in the tracking screen displayed in the small window 319 is switched. For example, if the tracking target is switched from the person corresponding to the tracking frame 320 to the person corresponding to the tracking frame 321, the tracking screen displayed in the small window 319 is changed accordingly.

The tracking frames may be part of the recording frames. In a possible implementation manner, the tracking picture is obtained by cutting the recording picture in real time according to a certain proportion based on the tracking target. The embodiment of the application does not specifically limit the frame displayed by the small window.

Optionally, the tracking target is centrally displayed in the tracking screen.

The widget 319 also includes a widget end control 322 and a widget recording duration.

It can be understood that, when the terminal device receives the operation of setting the tracking target by the user, a small window is displayed on the recording interface to display the tracking picture of the tracking target. When the terminal equipment does not receive the operation of setting the tracking target by the user, the recording interface does not display a small window.

When the user triggers the end control 318 through clicking, touching or other operations on the recording interface shown in fig. 3C, the terminal device receives the operation of ending recording by the user, and the terminal device enters the preview interface in the main angle mode, stores the video corresponding to the recording picture, and the focus tracking video corresponding to the tracking picture.

When the user triggers the pause control 317 by clicking, touching, etc. on the recording interface shown in fig. 3C, the terminal device receives the operation of the user to pause recording, and the terminal device pauses recording of video in the recording area 316 and recording of the focus-following video in the small window 319.

When the user triggers the widget ending control 322 through clicking, touching or other operations on the recording interface shown in fig. 3C, the terminal device receives the operation of ending the widget recording by the user, and the terminal device continues to display the recording picture in the recording area 316, closes the widget 319 and stores the focus tracking video corresponding to the tracking picture in the widget 319.

In a possible implementation, the recording interface further includes a flash control 323. When the flash control 323 is triggered, the terminal device can set a flash effect.

It can be understood that when the terminal device records in the main angle mode, a path of video can be generated based on the recording picture of the recording area, and a path of tracking target corresponding to the tracking video can be additionally generated based on the tracking picture of the small window. The two paths of videos are independently stored in the terminal equipment. Therefore, the video corresponding to the tracking target can be obtained without manually editing the whole video later, the operation is simple and convenient, and the user experience is improved.

It can be understood that, in the recording scenario, after the terminal device sets the tracking target, the tracking screen of the widget may display the tracking target centrally. In some scenarios, the tracking target may be in a moving state, and when the tracking target moves but does not leave the lens, the tracking screen of the widget may continuously display the tracking target centrally.

For example, the preview interface may be configured such that the tracking target object includes a male character and a female character, and the terminal device sets the male character as a tracking target in response to a click operation of a tracking frame for the male character by the user, and enters the interface as shown in a in fig. 3C. In the interface shown in a in fig. 3C, the tracking screen of the small window displays a male character centered on the right side of the female character. The male character moves, and the terminal device can continuously focus on the male character and display the male character in the small window in a centered manner. When the male character walks to the left of the female character, the interface of the terminal device may be as shown in b of fig. 3C. In the B interface in fig. 3B, the tracking screen of the small window still displays a male character centered on the left side of the female character.

In a possible implementation manner, when the terminal device tracks the target, the focus moves along with the movement of the tracked target, and in an interface shown in a in fig. 3C, the focus is located in the face area of the male character and is located in the middle right part of the screen; the male character moves, the terminal device can continue to focus on the male character, and when the male character walks to the left of the female character, the interface of the terminal device can be as shown in b of fig. 3C. In the interface shown in b in fig. 3C, the focus is located in the face area of the male character, in the middle left portion of the screen.

It can be appreciated that, in the embodiment of the present application, a shooting mode in which one or more tracking videos can be additionally generated based on a tracking target is defined as a principal angle mode, and the shooting mode may also be referred to as a tracking mode, which is not limited in the embodiment of the present application.

The manner of entering the main angle mode in the terminal device and the interface involved in recording will be described below with reference to fig. 4 to 7. Fig. 4 and fig. 5 are schematic views of two main angle mode entering flows according to the embodiments of the present application. Fig. 6 and fig. 7 are schematic diagrams of interfaces involved in recording according to embodiments of the present application.

Fig. 4 is an interface schematic diagram of a terminal device entering a main angle mode according to an embodiment of the present application.

When the terminal device receives the operation of opening the camera application 401 by the user in the main interface shown in a in fig. 4, the terminal device may enter the photographing preview interface shown in b in fig. 4. The photographing preview interface may include a preview area and a photographing mode selection item. The preview area displays a preview picture in real time; shooting mode selection items include, but are not limited to: portrait, photograph, video, professional or more 402.

When the user triggers more 402 on the camera preview interface shown in b in fig. 4 through clicking, touching or the like, the terminal device receives the operation of the user to view other types of shooting modes, and enters the shooting mode selection interface shown in c in fig. 4. The shooting mode selection interface includes: shooting mode selection items. Shooting mode selection items include, but are not limited to: professional, panoramic, high dynamic-range image (HDR), time-lapse photography, watermarking, document correction, high-pixel, micro-movie, principal angle mode 403, or other types of shooting mode selections.

When the user triggers the principal angle mode 403 through clicking, touching or other operations on the shooting mode selection interface shown in c in fig. 4, the terminal device receives the operation of selecting the principal angle mode preview by the user, and enters the preview interface corresponding to the principal angle mode shown in d in fig. 4. The preview interface includes: preview area and recording control. The preview area displays a preview screen. When the person exists in the preview screen, a tracking frame is also displayed in the preview area. When the user triggers the tracking frame through clicking or touching operation, the terminal device receives the operation of setting the tracking target, sets the person corresponding to the tracking frame as the tracking target, and displays the tracking picture corresponding to the tracking target on the display interface through the small window.

Fig. 5 is an interface schematic diagram of another terminal device entering a main angle mode according to an embodiment of the present application.

When the terminal device receives the operation of opening the camera application 501 by the user in the main interface shown in a in fig. 5, the terminal device may enter the photographing preview interface shown in b in fig. 5. The photographing preview interface may include a preview area and a photographing mode selection item. The preview area displays a preview picture in real time; shooting mode selection items include, but are not limited to: portrait, photograph, video 502, professional or other type of photography mode selection.

When the user triggers the video 502 through clicking, touching or other operations on the camera preview interface shown in b in fig. 5, the terminal device receives the operation of selecting the video preview by the user, and enters the video preview interface shown in c in fig. 5. The video preview interface comprises: preview area, recording parameter selection item and shooting mode selection item. The preview area displays a preview picture in real time; recording parameter options include, but are not limited to: a main angle mode 503, a flash, a filter, a setting, or other types of recording parameter selections. Shooting mode selection items include, but are not limited to: portrait, photograph, video, professional or other types of photography mode selections.

When the user triggers the principal angle mode 503 through clicking, touching or other operations on the video preview interface shown in c in fig. 5, the terminal device receives the operation of selecting the principal angle mode preview by the user, and enters the preview interface corresponding to the principal angle mode shown in d in fig. 5. The preview interface includes: preview area and recording control. The preview area displays a preview screen. When the person exists in the preview screen, a tracking frame is also displayed in the preview area. When the user triggers the tracking frame through clicking or touching operation, the terminal device receives the operation of setting the tracking target, sets the person corresponding to the tracking frame as the tracking target, and displays the tracking picture corresponding to the tracking target on the display interface through the small window.

It can be understood that when the terminal device enters the main angle mode, the terminal device can be horizontally placed in a horizontal screen state or can be vertically placed in a vertical screen state, and the principle that the terminal device realizes the main angle mode is similar in the horizontal screen state or the vertical screen state.

It can be understood that in the main angle mode of the camera, the terminal device may select the tracking target after starting recording, or may select the tracking target before starting recording the video. The following describes two recording processes with reference to fig. 6 and 7, respectively. Fig. 6 is an interface schematic diagram corresponding to a main angle mode recording flow provided in an embodiment of the present application.

When the user triggers the recording control 601 through clicking, touching or the like in the preview interface shown in a in fig. 6, the terminal device receives an operation of starting recording, and enters the recording interface shown in b in fig. 6. The recording interface includes: recording area 602, pause control 603, end control 604. The recording area displays a recording screen and a tracking frame 605. The tracking frame 605 may facilitate user selection of a tracking target.

When the user triggers the tracking frame 605 through clicking, touching, etc. operations in the recording interface shown in b in fig. 6, the terminal device receives the operation of setting the tracking target by the user, and the terminal device enters the recording interface shown in c in fig. 6, where the recording interface includes: a recording area, a pause control 606, an end control 607, a widget 608. The recording area displays a recording picture. The widget 608 includes a widget end control 609. The small window 608 displays a tracking screen corresponding to the tracking target. The tracking picture corresponding to the tracking target is a part of the recording picture.

On the basis of the flow shown in fig. 6, when the user triggers the pause control 606 through clicking or touching the recording interface shown in fig. 6 c, the terminal device receives the operation of suspending video recording, and the video recording is suspended, and the focus tracking video corresponding to the small window is also suspended.

When the user triggers the end control 607 through clicking or touching the recording interface shown in fig. 6 c, the terminal device receives the operation of ending video recording, the video recording ends, and the recording of the focus tracking video corresponding to the small window ends.

When the user triggers the small window ending control 609 through clicking or touching on the recording interface shown in fig. 6 c, the terminal device receives the operation of ending the recording of the focus tracking video, the recording of the focus tracking video corresponding to the small window ends, and the video continues to be recorded.

When the user triggers the widget 608 through a drag operation in the recording interface shown in fig. 6 c, the widget 608 position may be moved.

The moving distance of the widget 608 is related to the distance between the drag operation start position and the drag operation end position, and the moving direction of the widget 608 is related to the direction of the drag operation.

Fig. 7 is an interface schematic diagram corresponding to a main angle mode recording flow provided in an embodiment of the present application.

When the user triggers the tracking frame 701 by clicking, touching, or the like in the preview interface shown in a in fig. 7, the terminal device receives an operation of setting a tracking target by the user, and enters the preview interface shown in b in fig. 7. The preview interface includes: preview area 702, recording control 703 and widget 704. The recording area displays a preview picture. The widget 704 displays a tracking screen. The tracking screen corresponds to a tracking target. The widget 704 also includes a close control 705 and a first switch control 706.

When the user triggers the recording control 703 through clicking, touching or other operations in the preview interface shown in b in fig. 7, the terminal device receives an operation of starting recording, and enters the recording interface shown in c in fig. 7. The recording interface includes: a recording area, a pause control 707, an end control 708, and a widget 709. The recording area displays a recording picture. Widget 709 includes widget ending control 710. The small window 709 displays a tracking screen corresponding to the tracking target. The tracking frame is a part of the recording frame.

The roles of pause control 707, end control 708, and widget 709 may be referred to in the relevant description of fig. 6 and will not be repeated here.

On the basis of the flow shown in fig. 7, when the user triggers the close control 705 by clicking, touching or the like in the preview interface shown in b in fig. 7, the terminal device receives the operation of closing the widget, closes the widget, and cancels the preview of the tracking target.

When the user triggers the first switching control 706 of the recording control through clicking, touching or other operations in the preview interface shown in b in fig. 7, the terminal device receives the operation of switching the display mode of the small window, and the terminal device switches the display mode of the small window. In particular, the portlets may be switched from landscape to portrait or vice versa.

In a possible implementation, the terminal device may also adjust the size of the small window. The embodiment of the application does not limit a specific implementation manner of the size adjustment of the small window.

The terminal equipment can start the focus tracking video recording of the small window based on the scene and obtain multiple paths of videos. It should be noted that, the small window may display the picture related to the tracking target in the preview area/recording area, but the video recorded by the small window and the video recorded by the recording area are multiple independent videos, and are not a composite video in the form of picture-in-picture in which the tracking picture of the small window is nested in the recording picture of one recording area.

It should be noted that, if the terminal device does not open the recording of the small window, the terminal device may obtain a path of video recorded in the recording area. If the terminal equipment starts the small window recording, the terminal equipment can obtain one path of video recorded in the recording area and one path or multiple paths of video recorded in the small window. For example, during the video recording in the recording area, the terminal device may open the window recording multiple times, where the terminal device may end the recording of the window when detecting the clicking operation for the window ending control, and obtain one video. After the small window is opened again for recording, the terminal equipment can obtain a new video. The number of videos obtained by the terminal device based on the small window can be related to the number of times the small window is opened for recording.

Optionally, the user may browse the videos recorded in the recording area and the multiple videos recorded in the small window based on the album of the camera application, and the display sequence of the multiple videos may be the recording sequence of the videos, that is, the terminal device may sort the videos according to the ending time point or the starting time point of the recorded videos. The display sequence of the multiple paths of videos can be the reverse sequence of video recording, namely, the terminal equipment can be arranged in the reverse sequence according to the ending time or the starting time of video recording.

Alternatively, the video recorded in the recording area and the video recorded in the small window may be displayed in a video thumbnail of the same album interface. In order to facilitate distinguishing the video recorded in the recording area from the video recorded in the small window, the terminal device may set an identifier for the video recorded in the small window. For example, the terminal device may add an outer border, a font, a graphic, and the like to the video recorded in the small window, and may further set the size of the video thumbnail recorded in the small window, so that the small window and the video thumbnail recorded in the recording area have a size difference. It can be appreciated that the embodiment of the application does not limit the form of the video thumbnails in the album, the arrangement sequence of the video thumbnails, the storage sequence of the video, and the like.

It will be appreciated that when the terminal device sets the tracking target, a small window appears at the interface of the terminal device. In the embodiment of the application, the position, specification, display style and the like of the small window can be adjusted.

The procedure of adjusting the widget position and widget specification will be described with reference to fig. 8 to 12.

Illustratively, the interface shown as a in FIG. 8 includes a widget 801 and a preview area 802. A small window 801 is displayed in the lower left corner of preview area 802. When the user presses an arbitrary area of the widget 801 in the interface shown in a in fig. 8 by a finger or a stylus pen or the like and moves the touch position, the terminal device receives an operation of dragging the widget movement, and enters the interface shown in b in fig. 8. In the interface shown in b in fig. 8, the display position of the widget 803 moves along with the user touch position, and during the drag, the terminal device may also set a hidden part or all of the controls (e.g., the close control 804, the first switch control 805, etc.) to prevent false triggering. When the user's finger or stylus or the like leaves the screen, the terminal device receives the lift-up operation, stops moving the widget, and enters the interface shown as c in fig. 8. The interface includes a widget 806 and a preview area 807. A small window 806 is displayed in the upper left corner of preview area 807.

Compared to the position of the small window in the interface shown in a in fig. 8, the position of the small window in the interface shown in c in fig. 8 changes from the lower left corner of the preview area to the upper left corner of the preview area. It will be appreciated that the distance, direction, etc. that the position of the widget moves is related to the distance, direction, etc. that the user's finger or stylus moves during the drag operation.

In the embodiment of the application, the user can adjust the position of the small window in real time, the shielding of the small window to the preview picture is reduced, and the user experience is improved.

In the embodiment shown in fig. 8, the position of the small window is flexibly and rapidly adjusted by dragging operation. The terminal device may also implement adjustment of the widget in other ways, for example, by setting a movement azimuth control to move the position of the adjustment widget up, down, left or right. The embodiment of the application does not limit the adjustment of the position of the small window.

In the embodiment shown in fig. 8, the adjustment of the position of the small window is described, and the adjustment of the small window specification is described below with reference to fig. 9.

Illustratively, when the user presses an arbitrary position of the widget 901 through two fingers and adjusts the distance of the two fingers at the interface shown in a of fig. 9, the terminal device receives an operation of adjusting the widget specification, and enters the interface shown in b of fig. 9. In the interface shown in b in fig. 9, the specification adjustment of the widget 902 is related to the distance between two fingers, and during the change of two fingers, the terminal device may also set a hidden part or all of the controls (e.g. the closing control 903, the first switching control 904, etc.) to prevent false triggering.

It can be understood that the terminal device adjusts the widget specification accordingly based on the amount of change of the double-finger distance, for example, the widget is reduced when the double-finger distance is reduced, and the widget is increased when the double-finger distance is increased.

When the user leaves the screen with both fingers, the terminal device receives an operation to stop adjustment, stops adjusting the widget specification, and enters an interface as shown by c in fig. 9. The size of the small window 905 in this interface corresponds to the distance of the two fingers from the screen.

The specification of the small window in the embodiment of the application can be adjusted in a self-defined manner, a user can adjust the specification of the small window to a proper size, the user can more clearly view the tracking picture or reduce shielding of the preview picture, and user experience is improved.

The embodiment shown in fig. 9 adjusts the window size by varying the finger distance. The terminal device may also implement adjustment of the widget in other manners. For example, the terminal device may adjust the widget specification through a control having a magnification/reduction function. The terminal equipment can set a small window adjusting menu, and the small window specification is adjusted by manually inputting parameters such as length/width and the like. The embodiment of the application does not limit the adjustment of the specification of the small window.

It can be appreciated that, during the recording process, the position, specification, etc. of the small window may also be adjusted, and the adjusting process is similar to the adjusting process in the preview scene, and specific reference may be made to the above related description, which is not repeated here.

It should be noted that, in one possible implementation, when the terminal device adjusts the specification of the small window, the tracking frame of the small window may be enlarged and reduced in a certain proportion with respect to the original tracking frame of the small window. For example, the content in the tracking picture displayed by the small window is unchanged, the original tracking picture is simply enlarged according to a certain proportion according to the distance adjusted by the double fingers, and the characters and the background in the original tracking picture are correspondingly enlarged, so that an enlarged tracking picture is obtained, as shown in fig. 9. This enables the user to clearly browse the tracking screen. It can be understood that if the size of the small window is adjusted during the recording process, the small window is not affected to record the focus-following video, i.e. discontinuous pictures which are suddenly enlarged or reduced during the playing process of the small window video cannot appear. The method improves the ornamental value of the recording process, and meanwhile, the smoothness of the video in playing is not affected.

In another possible implementation, when the terminal device adjusts the specification of the small window, the tracking frame of the small window is enlarged and reduced relative to the recording frame of the recording area, and illustratively, during the enlargement process of the small window, the content in the tracking frame displayed by the small window is increased. The terminal device may add content in the tracking frame of the widget according to the distance of the two-finger adjustment, for example, the terminal device cuts out more content in the preview frame of the preview area and previews in the widget, which is shown as the characters in the tracking frame of the widget are consistent with the characters in the original tracking frame in size, but the background in the tracking frame is increased. In the method, the user can adjust the display proportion of the tracking target in the focus tracking video based on the enlargement and the reduction of the small window, the tracking target can be better displayed, and the recording experience of the user is further improved.

It can be appreciated that when the terminal device adjusts the specification of the widget, the widget may exceed the preview area, resulting in incomplete display of the widget. Based on this, embodiments of the present application provide adjustment strategies to reduce instances of window display incompleteness.

For ease of understanding, the preview area, the widget, the zoom-in direction, etc. are described below in connection with fig. 10. As illustrated in fig. 10, the preview area 1001 includes a first edge E1 and a second edge E2 facing each other, and a third edge E3 and a fourth edge E4 located between the first edge E1 and the second edge E2 and facing each other, wherein the first edge and the second edge are a left edge and a right edge in a lateral screen placement state of the mobile phone, respectively. The first edge E1 is adjacent to the camera. The first edge E1 and the third edge E3 may be connected by a first corner CN1, and the second edge E2 and the third edge E3 may be connected by a second corner CN 2. The first edge E1 and the fourth edge E4 may be connected by a third corner CN3, and the second edge E2 and the fourth edge E4 may be connected by a fourth corner CN 4.

It will be appreciated that the first corner CN1 and the fourth corner CN4 are diagonal to each other; the second corner CN2 and the third corner CN3 are diagonal to each other.

It will be appreciated that when the terminal device is horizontally positioned and the camera is on the left side of the terminal device, the first edge to the fourth edge may be referred to as the left edge of the preview area, the right edge of the preview area, the upper edge of the preview area and the lower edge of the preview area, respectively. The first through fourth corners may be referred to as an upper left corner of the preview area, an upper right corner of the preview area, a lower left corner of the preview area, and a lower right corner of the preview area, respectively. When the terminal device is a vertical screen display, the first to fourth edges may be referred to as an upper edge of the preview area, a lower edge of the preview area, a right edge of the preview area, and a left edge of the preview area, respectively. The first through fourth corners may be referred to as an upper right corner of the preview area, a lower right corner of the preview area, an upper left corner of the preview area, and a lower left corner of the preview area, respectively.

The widget 1002 includes: a fifth edge E5 and a sixth edge E6 facing each other, and a seventh edge E7 and an eighth edge E8 located between the fifth edge E5 and the sixth edge E6 and facing each other. The fifth edge E5 is the shortest distance from the camera among the fifth edge E5 to the eighth edge E8. The fifth edge E5 and the seventh edge E7 may be connected through a fifth corner CN5, and the sixth edge E6 and the seventh edge E7 may be connected through a sixth corner CN 6. The fifth edge E5 and the eighth edge E8 may be connected by a seventh corner CN7, and the sixth edge E6 and the eighth edge E8 may be connected by an eighth corner CN 8.

It will be appreciated that the fifth corner CN5 and the eighth corner CN8 are diagonal to each other; the sixth corner CN6 and the seventh corner CN7 are diagonal to each other.

It will be appreciated that when the terminal device is horizontally positioned and the camera is on the left side of the terminal device, the fifth to eighth edges may be referred to as the left edge of the small window, the right edge of the small window, the upper edge of the small window and the lower edge of the small window, respectively. The fifth corner to the eighth corner may be referred to as an upper left corner of the widget, an upper right corner of the widget, a lower left corner of the widget, and a lower right corner of the widget, respectively. When the terminal device is a vertical screen display, the fifth to eighth edges may be referred to as an upper edge of the widget, a lower edge of the widget, a right edge of the widget, and a left edge of the widget, respectively. The fifth corner to the eighth corner may be referred to as an upper right corner of the widget, a lower right corner of the widget, an upper left corner of the widget, and a lower left corner of the widget, respectively.

In a possible implementation manner, the terminal device adjusts the widget specification based on a preset corner sequence and a diagonal direction corresponding to each corner.

The terminal device may preset a corner whose position is unchanged when the widget specification is adjusted, which may be referred to as a preset corner. In the process of adjusting the specification of the small window, when the small window intersects with the edge of the preview area in the adjustment direction, the terminal device adjusts the preset corners of the reference, and in the process, the determined rules of different preset corners, namely the preset corner sequence. Specifically, taking a small window as a quadrilateral as an example, the terminal equipment controls the first preset corner position of the small window to be unchanged, and adjusts the specification of the small window along the diagonal direction corresponding to the first preset corner; when any edge of the small window, which is not adjacent to the first preset corner, is intersected with any edge of the preview area, the terminal equipment controls the second preset corner position of the small window to be unchanged, and adjusts the specification of the small window along the diagonal direction corresponding to the second preset corner; when any edge of the small window, which is not adjacent to the second preset corner, is intersected with any edge of the preview area, the terminal equipment controls the third preset corner position of the small window to be unchanged, and adjusts the specification of the small window along the diagonal direction corresponding to the third preset corner; when any edge of the small window, which is not adjacent to the third preset corner, is intersected with any edge of the preview area, the terminal equipment controls the fourth preset corner position of the small window to be unchanged, and adjusts the small window specification along the diagonal direction corresponding to the fourth preset corner. The first preset corner, the second preset corner, the third preset corner and the fourth preset corner are all different.

Therefore, when the edge of the small window is intersected with the edge of the preview area, the terminal equipment can switch the direction of amplifying and extending the small window, so that the situation that the small window exceeds the preview area in the amplifying process is reduced, and the phenomenon that the small window is not completely displayed is reduced.

The process of magnifying and adjusting the small window at different locations in a possible implementation one is described below with reference to fig. 11A and 11B.

Illustratively, taking the example that the terminal device is horizontally placed and the camera is located at the left side of the terminal device, the first preset corner to the fourth preset corner are respectively the lower left corner of the small window (seventh corner CN 7), the lower right corner of the small window (eighth corner CN 8), the upper right corner of the small window (sixth corner CN 6) and the upper left corner of the small window (fifth corner CN 5).

As shown by a in fig. 11A, the widget is in the upper right portion of the preview area. When the terminal device receives an operation of enlarging the widget in the interface shown in a in fig. 11A, the position of the lower left corner (seventh corner CN 7) of the widget is controlled to be unchanged, and the extended widget is enlarged in the direction of the upper right corner, and enters the interface shown in b in fig. 11A.

Since the right edge (sixth edge E6) of the interface shown in b in fig. 11A, which is not adjacent to the lower left corner (seventh corner CN 7) of the widget, intersects the right edge (second edge E2) of the preview area, the terminal device controls the position of the lower right corner (eighth corner CN 8) of the widget to be unchanged, enlarges and lengthens the widget in the direction of the upper left corner, and the terminal device enters the interface shown in c in fig. 11A.

Since the upper edge (seventh edge E7) of the interface shown in c in fig. 11A, which is not adjacent to the lower right corner (eighth corner CN 8) of the widget, intersects with the upper edge (third edge E3) of the preview area, the terminal device controls the position of the upper right corner (sixth corner CN 6) of the widget to be unchanged, enlarges and lengthens the widget in the direction of the lower left corner, and enters the interface shown in d in fig. 11A.

As shown by a in fig. 11B, the widget is at the upper left portion of the preview area. When the terminal device receives an operation of enlarging the widget in the interface shown in a in fig. 11B, the terminal device controls the position of the lower left corner (seventh corner CN 7) of the widget to be unchanged, enlarges the extended widget in the direction of the upper right corner, and enters the interface shown in B in fig. 11B.

Since the upper edge (seventh edge E7) of the small window, which is not adjacent to the lower left corner (seventh corner CN 7) of the small window, in the interface shown in B of fig. 11B intersects with the upper edge (third edge E3) of the preview area, the terminal device controls the position of the lower right corner (eighth corner CN 8) of the small window to be unchanged, enlarges and lengthens the small window in the direction of the upper left corner, and enters the interface shown in c of fig. 11B.

Since the upper edge (seventh edge E7) of the small window, which is not adjacent to the lower right corner (eighth corner CN 8) of the small window, in the interface shown in c in fig. 11B intersects with the upper edge (third edge E3) of the preview area, the terminal device controls the position of the upper right corner (sixth corner CN 6) of the small window to be unchanged, enlarges and lengthens the small window in the direction of the lower left corner, and enters the interface shown in d in fig. 11B.

Since the upper edge (fifth edge E5) of the small window, which is not adjacent to the upper right corner (sixth corner CN 6) of the small window, in the interface shown in d in fig. 11B intersects with the left edge (first edge E1) of the preview area, the terminal device controls the position of the upper left corner (fifth corner CN 5) of the small window to be unchanged, enlarges and lengthens the small window in the direction of the lower left corner, and enters the interface shown in E in fig. 11B.

It can be understood that in the embodiment shown in fig. 11B, since the terminal device adjusts the widget specifications based on the lower left corner of the widget and the lower right corner of the widget, both the upper edge (seventh edge E7) of the widget and the upper edge (third edge E3) of the preview area, the specifications of the widget in the interface shown in c in fig. 11B are the same as those of the widget in the interface shown in d in fig. 11B.

It will be appreciated that the first to fourth predetermined corners described above each correspond to one of the 4 corners of the widget. The embodiment of the present application does not limit the specific correspondence.

In the above embodiment, the widget may adjust the widget specification based on the order of the preset corners, and in another possible implementation, when the edge of the widget intersects with the edge of the preview area, the terminal device may further determine a new preset corner based on the intersection point of the widget and the preview area.

In this embodiment of the present application, the first preset corner is a preset corner. When the widget intersects the edge of the preview area in the adjustment direction, the terminal device adjusts the preset corner of the reference based on the intersected edge.

Specifically, the corner, which is closer to the first preset corner, of the corners connected to the intersecting edge of the preview area in the adjustment direction based on the small window is a new preset corner, or it may be understood that the corner, which is adjacent to the first preset corner, of the corners connected to the intersecting edge of the preview area in the adjustment direction based on the small window is a new preset corner.

Taking a small window as a quadrangle as an example, the terminal equipment controls the first preset corner position of the small window to be unchanged, and adjusts the specification of the small window along the diagonal direction corresponding to the first preset corner; when any edge of the small window, which is not adjacent to the first preset corner, is intersected with any edge of the preview area, the terminal equipment is based on that a corner, which is close to the first preset corner, in corners connected with the intersected edges in the diagonal direction corresponding to the first preset corner is a second preset corner;

the terminal device controls the position of a second preset corner of the small window to be unchanged, and adjusts the specification of the small window along the diagonal direction corresponding to the second preset corner; when any edge of the small window, which is not adjacent to the second preset corner, is intersected with any edge of the preview area, the terminal equipment is based on that a corner, which is closer to the second preset corner, in corners connected with the intersected edges in the diagonal direction corresponding to the second preset corner is a third preset corner;

the terminal equipment controls the third preset corner position of the small window to be unchanged, and adjusts the specification of the small window along the diagonal direction corresponding to the third preset corner; when any edge of the small window, which is not adjacent to the third preset corner, is intersected with any edge of the preview area, the terminal equipment is based on that a corner, which is closer to the third preset corner, in corners connected with the intersected edges in the diagonal direction corresponding to the third preset corner is a fourth preset corner;

The terminal equipment controls the fourth preset corner position of the small window to be unchanged, and adjusts the specification of the small window along the diagonal direction corresponding to the fourth preset corner. The first preset corner, the second preset corner, the third preset corner and the fourth preset corner are all different.

Illustratively, taking the example that the terminal device is horizontally placed and the camera is located at the left side of the terminal device, the first preset corner is the lower left corner of the small window (seventh corner CN 7).

As shown by a in fig. 11C, the widget is at the upper left portion of the preview area. When the terminal device receives an operation of enlarging the widget in the interface shown in a in fig. 11C, the terminal device controls the position of the lower left corner (seventh corner CN 7) of the widget to be unchanged, enlarges the extended widget in the direction of the upper right corner, and enters the interface shown in b in fig. 11C.

Since the upper edge (seventh edge E7) of the small window, which is not adjacent to the lower left corner (seventh corner CN 7) of the small window, in the interface shown in b in fig. 11C intersects with the upper edge (third edge E3) of the preview area, the terminal device determines the corner adjacent to the lower left corner (seventh corner CN 7) of the small window, i.e., the upper left corner (fifth corner CN 5) of the small window, as the second preset corner, based on the upper edge (seventh edge E7) of the small window.

The terminal device controls the position of the upper left corner (fifth corner CN 5) of the widget, enlarges the extended widget in the direction of the lower right corner, and enters the interface shown as c in fig. 11B.

Since the right edge (sixth edge E6) of the small window that is not adjacent to the upper left corner (fifth corner CN 5) in the interface shown in C in fig. 11C intersects the right edge (second edge E2) of the preview area, the terminal device determines the corner adjacent to the upper left corner (fifth corner CN 5) of the small window, i.e., the upper right corner (sixth corner CN 6) of the small window is the third preset corner, based on the right edge (sixth edge E6) of the small window.

The terminal device controls the position of the upper right corner (sixth corner CN 6) of the widget, enlarges the extended widget in the direction of the lower left corner, and enters the interface shown as d in fig. 11B.

In a second possible implementation manner, the terminal device determines a preset corner based on the position of the widget in the preview area, and adjusts the widget specification along the diagonal direction corresponding to the preset corner.

In this embodiment, taking the small window as a quadrilateral as an example, the preset corner is a corner connected to two edges with the smallest edge distance from the preview area among the 4 edges of the small window. Alternatively, it can be understood that among the 4 corners of the widget, the corner corresponding to the shortest distance among the corresponding four corners of the preview area.

The process of magnifying and adjusting the small window at a different location in the second possible implementation is described below with reference to fig. 12.

Illustratively, as shown in a of fig. 12, before the widget specification is adjusted, the distance between the upper right corner (sixth corner CN 6) of the widget and the upper right corner (second corner CN 2) of the preview area is the smallest in the 4 corners of the widget, and the terminal device controls the position of the upper right corner (sixth corner CN 6) of the widget to be unchanged, and enlarges and lengthens the widget in the direction of the lower left corner.

Or it may be understood that, before the specification of the widget is adjusted, the distance between the upper edge (seventh edge E7) of the widget and the right edge (sixth edge E6) of the widget and the edge of the preview area is small, the preset corner is the upper right corner of the widget, the terminal device controls the position of the upper right corner (sixth corner CN 6) of the widget to be unchanged, and enlarges and extends the widget along the direction of the lower left corner.

As shown in b in fig. 12, before the widget specification is adjusted, the distance between the upper left corner (fifth corner CN 5) of the widget and the upper left corner (first corner CN 1) of the preview area is the smallest, and the terminal device controls the position of the upper left corner (fifth corner CN 5) of the widget to be unchanged, and enlarges and lengthens the widget in the direction of the lower right corner.

Or it may be understood that, before the specification of the widget is adjusted, the distance between the upper edge (seventh edge E7) of the widget and the left edge (fifth edge E5) of the widget and the preview area is the smallest among the 4 edges of the widget, the preset corner is the upper left corner of the widget, the terminal device controls the position of the upper left corner (fifth corner CN 5) of the widget to be unchanged, and enlarges and extends the widget along the direction of the lower right corner.

It should be noted that, the terminal device may limit the maximum specification of the small window, so that the shielding of the preview screen by the small window may be reduced. In a possible implementation, the length of the small window does not exceed half the length of the preview area, or the width of the small window does not exceed half the width of the preview area, or the area of the small window does not exceed half the area of the preview area, or the length of the small window does not exceed the width of the preview area. In this way, the situation that the preview screen is blocked too much can be reduced. The maximum specification of the small window is not particularly limited in the embodiment of the application.

The display style switching of the widget is described below with reference to fig. 13A and 13B.

In one possible implementation, the horizontal and vertical screen previews of the preview area relate to the placement direction of the terminal device, wherein when the terminal device is horizontally placed, the preview area can display a picture of the horizontal screen previews; when the terminal equipment is vertically placed, the preview area can display a picture of vertical screen preview.

The terminal device can also switch the horizontal screen preview and the vertical screen preview of the small window, and the terminal device can control the small window to be switched from the horizontal screen preview to the vertical screen preview or from the vertical screen preview to the horizontal screen preview through a first switching control in the small window. Or the terminal equipment can control the small window to be switched from the horizontal screen preview to the vertical screen preview or from the vertical screen preview to the horizontal screen preview through the second switching control

In another possible implementation, the horizontal and vertical screen previews of the preview area and the horizontal and vertical screen previews of the small window are set in a linkage manner, and when the horizontal and vertical screen previews of the preview area are switched, the horizontal and vertical screen previews of the small window are changed. However, the preview mode of the preview area and the widget may be the same or different, for example, the preview area may be a landscape screen preview, the widget may be a landscape screen/portrait screen preview, or the preview area may be a portrait screen preview, and the widget may be a landscape screen/portrait screen preview. For example, when the terminal equipment is horizontally placed, the preview area is a horizontal screen preview, if the small window is vertical screen/horizontal screen preview; and when the terminal equipment is switched from horizontal placement to vertical placement, the preview area is switched to vertical screen preview, and the small window is switched to horizontal screen/vertical screen preview.

The procedure of realizing the widget style switching by the control will be described with reference to fig. 13A and 13B, respectively.

Fig. 13A is an interface schematic diagram corresponding to the implementation of the widget style switching through the first switching control in the embodiment of the present application. As shown in fig. 13A, a widget of the cross-screen preview is displayed in the interface shown as a in fig. 13A, and a closing control and a first switching control 1302 are included in the widget 1301. The first switching control 1302 may take the form of a landscape frame pointing to a portrait frame, which facilitates the user's understanding that the widget is currently landscape and switchable to portrait.

When the user triggers the first switching control 1302 by clicking, touching, or the like in the interface shown in a in fig. 13A, the terminal device receives an operation of switching the widget style, and enters the interface shown in b in fig. 13A, which includes the widget 1303. The widget includes a close control and a first switch control 1304. In contrast to small window 1301, small window 1303 is vertical.

The first switch control 1304 may take the form of a mullion pointing toward a transom, facilitating the user's understanding that the widget is currently vertically previewed, and may be switched to landscape.

When the user triggers the first switching control 1304 by clicking, touching, or the like in the interface shown in b in fig. 13A, the terminal device receives an operation of switching the widget style, and enters the interface shown in a in fig. 13A.

It can be understood that the horizontal and vertical switching of the widget does not affect the preview image of the preview area, for example, when the terminal device is horizontally placed, the preview area is a horizontal screen preview, and when the widget is switched from horizontal preview to vertical preview based on the control, the preview image displayed in the preview area is not changed and is still a horizontal screen preview. The preview picture in the small window is adapted to the small window specification change, and when the small window is changed from the transverse direction to the vertical direction, the preview picture in the small window is changed from the transverse direction to the vertical direction, namely, the transverse length is larger than the longitudinal length, and the longitudinal length is larger than the transverse length.

Optionally, in order to enhance the ornamental value of the small window during style switching display, the terminal device may set a dynamic special effect. When the user clicks the first switching control in the widget, the terminal device responds to the operation, and in the clicking process, a dynamic special effect appears at the corresponding position of the first switching control, and the dynamic special effect can be suspended above the control. The icons of the dynamic special effects may define settings size, shape, color, etc. Further, in order to enable the pictures of the small window to be smoother when the horizontal screen and the vertical screen are switched, the terminal equipment can carry out fuzzy processing on the tracking pictures of the small window in the process of switching the horizontal screen and the vertical screen of the small window, so that the problems of deformation, distortion and fuzzy of characters, backgrounds and the like in the switching process are reduced, and the attractiveness of the small window is improved.

It can be appreciated that the terminal device can also generate a dynamic special effect at the corresponding position of clicking when detecting that the clicking operation is performed in the widget, so as to indicate that the user performs the clicking operation in the widget. For example: when the terminal equipment receives the specification of the double-finger adjustment small window, the position of the sliding drag adjustment small window and the single-click small window area, the terminal equipment can generate a dynamic special effect. The method and the device do not limit the generation scene of the dynamic special effect.

Fig. 13B is an interface schematic diagram corresponding to the implementation of the widget style switching through the second switching control in the embodiment of the present application.

As shown in fig. 13B, the interface shown by a in fig. 13B includes a preview area 1305, a widget 1306, and a second switch control 1307. The small window 1306 displays a preview in the landscape orientation, and the preview area 1305 of the terminal apparatus displays a preview screen and a second switch control 1307.

The second switch control 1307 may be represented by a combination of a solid frame and a rectangle, or may be in other forms, which are not limited herein. The rectangle in the second switching control can represent horizontal previewing of the small window when placed horizontally, and can represent vertical previewing of the small window when placed vertically.

When the user triggers the second switching control 1307 by clicking, touching or the like in the interface shown in a in fig. 13B, the terminal device receives an operation of setting the widget style, and enters the interface shown in B in fig. 13B. The interface includes a landscape display control 1308 and a portrait display control 1309.

The landscape display control 1308 and the portrait display control 1309 may be in the form of icons or text, which is not limited in the embodiment of the present application.

It can be appreciated that the lateral display control 1308 and the vertical display control 1309 may be two independent controls, or may be different states of the same control, and the specific display and control modes of the terminal device are not limited herein.

When the end user triggers the vertical display control 1309 by clicking, touching, or the like in the interface shown in B in fig. 13B, the terminal device enters the interface shown in c in fig. 13B. The interface includes a preview area, a widget 1310 and a second switch control 1311, the widget 1310 displaying a preview vertically, and the second switch control 1311 displaying a style when the preview vertically. Optionally, the terminal device may also set a dynamic special effect and a fuzzy process in the process of switching the horizontal screen and the vertical screen of the small window, which will not be described herein.

It should be noted that in the above two processes of switching the widget style, the first switching control in the widget and the second switching control in the preview area may be set to be linked. For example, when the widget is a landscape preview, the first switching control appears as a style when the landscape preview, and the second switching control also appears as a style when the landscape preview.

It can be understood that when the terminal device adjusts the display style of the widget, the widget may exceed the preview area, resulting in incomplete display of the widget. Based on this, the present embodiments provide two adjustment strategies to reduce instances of window display incompleteness.

The following describes an adjustment strategy for switching the small window from the horizontal direction to the vertical direction and an adjustment strategy for switching the small window from the vertical direction to the horizontal direction.

It should be noted that, taking the example that the terminal device is horizontally placed, when the small window is horizontally displayed, the long side of the small window is parallel to the long side of the preview area; when the small window is displayed vertically, the long side of the small window is perpendicular to the long side of the preview area.

The adjustment strategy for switching from horizontal to vertical may be: the terminal equipment controls the first preset corner position of the small window to be unchanged, controls the small window to extend along the first preset direction and controls the small window to shorten along the second preset direction. When the edge of the small window is intersected with the edge of the preview area in the first preset direction, the terminal equipment controls the small window to extend along the opposite direction of the first preset direction and to shorten along the second preset direction.

In this embodiment of the present application, the first preset direction may be an extension of a direction parallel to a short side in a landscape display state, and may be an upward direction or a downward direction. The second preset direction is a direction perpendicular to the short side in the horizontal screen display state, and can be left or right.

In a possible implementation manner one, the first preset direction is a preset direction of the terminal device, and the first distance is assumed to be the length of the long side of the small window, and the second distance is assumed to be the distance between the fifth preset corner of the small window and the edge of the preview area in the first preset direction. When the first distance is smaller than or equal to the second distance, the terminal equipment controls the fifth preset corner position of the small window to be unchanged, and controls the small window to extend along the first preset direction.

Illustratively, taking the fifth preset corner as the lower left corner of the small window (seventh corner CN 7), the first preset direction is the upper edge direction (third edge direction) of the preview area, and the first distance is the length of the small window, that is, the length of the upper edge (seventh edge E7) or the length of the lower edge (eighth edge E8) of the small window. The second distance is the distance between the lower left corner of the widget (seventh corner CN 7) and the upper edge of the preview area (third edge E3).

As shown in a of fig. 14A, the widget is located at the lower left portion of the preview area, and the first distance m is smaller than the second distance n. When the terminal device receives an operation of switching the widget style at the interface shown in a of fig. 14A, the terminal device controls the position of the lower left corner of the widget to be unchanged, extends the widget toward the upper edge (third edge E3) of the preview area, shortens the widget toward the left edge (first edge E1) of the preview area, and enters the interface shown in b of fig. 14A.

In a second possible implementation manner, when the first distance is greater than the second distance, the terminal device controls the fifth preset corner position of the small window to be unchanged, controls the small window to extend along the first preset direction and controls the small window to shorten along the second preset direction; when the edge of the small window is intersected with the edge of the preview area in the first preset direction, the small window is controlled to extend along the opposite direction of the first preset direction and to shorten along the second preset direction.

As shown in a of fig. 14B, the widget is located at the upper left portion of the preview area, and the first distance m is greater than the second distance n. When the terminal device receives an operation of switching the widget style at the interface shown in a of fig. 14B, the terminal device controls the position of the lower left corner of the widget to be unchanged, extends the widget upward, shortens the widget toward the left edge (first edge E1) of the preview area, and enters the interface shown in B of fig. 14B.

When the upper edge of the small window intersects with the upper edge of the preview area, the terminal device lengthens the small window in the opposite direction to the first preset direction (the direction of the lower edge of the preview area), shortens the small window toward the left edge of the preview area (the first edge E1), and enters the interface shown as c in fig. 14B.

In a third possible implementation manner, the first preset direction is a direction preset by the terminal device, and the terminal device determines a direction in which the small window extends based on the first distance, the second distance and the fourth distance.

In the embodiment of the application, the first distance is the length of the long side of the small window; the second distance is the distance between the fifth preset corner of the small window and the edge of the preview area in the first preset direction; the fourth distance is the distance between the corner of the small window adjacent to the fifth preset corner and in the first preset direction and the edge of the preview area in the direction opposite to the first preset direction.

For example, when the first distance is less than or equal to the second distance, the terminal device controls the fifth preset corner position of the widget to be unchanged, and controls the widget to be lengthened along the first preset direction and shortened along the second preset direction.

Taking the fifth preset corner as the lower left corner (seventh corner CN 7) of the small window, the first preset direction is the upper edge direction (third edge direction) of the preview area, the second preset direction is the left edge direction (first edge direction) of the preview area as an example, and the first distance is the length of the small window, that is, the length of the upper edge (seventh edge E7) or the length of the lower edge (eighth edge E8) of the small window. The second distance is the distance between the lower left corner of the widget (seventh corner CN 7) and the upper edge of the preview area (third edge E3). The fourth distance is the distance between the upper left corner of the widget (fifth corner CN5 and the lower edge of the preview area (eighth edge E8).

As shown in a of fig. 14C, the widget is located at the lower left portion of the preview area, and the first distance m is smaller than the second distance n. When the terminal device receives an operation of switching the widget style at the interface shown in a of fig. 14C, the terminal device controls the position of the lower left corner of the widget to be unchanged, extends toward the upper edge (third edge E3) of the preview area, shortens the widget toward the left edge (first edge E1) of the preview area, and enters the interface shown in b of fig. 14C.

For example, when the first distance is greater than the second distance and less than or equal to the fourth distance, the terminal device controls the position of the corner of the widget in the first preset direction to be unchanged, and controls the widget to extend in the opposite direction of the first preset direction and to shorten in the second preset direction.

As shown in b of fig. 14D, the widget is located at the lower left portion of the preview area, and the first distance m is greater than the second distance n and less than the fourth distance q. When the terminal device receives an operation of switching the widget style at the interface a in fig. 14D, the terminal device controls the position of the upper left corner of the widget to be unchanged, to extend toward the lower edge (eighth edge E8) of the preview area, to shorten toward the left edge (first edge E1) of the preview area, and to enter the interface b in fig. 14D.

The terminal device controls the fifth preset corner position of the small window to be unchanged and controls the small window to be lengthened along the first preset direction and shortened along the second preset direction when the first distance is larger than the second distance and larger than the fourth distance; when the edge of the small window is intersected with the edge of the preview area in the first preset direction, the small window is controlled to extend along the opposite direction of the first preset direction and to shorten along the second preset direction.

Taking the fifth preset corner as the lower left corner (seventh corner CN 7) of the small window, the first preset direction is the upper edge direction (third edge direction) of the preview area, the second preset direction is the left edge direction (first edge direction) of the preview area, and the first distance is the length of the small window, that is, the length of the upper edge (seventh edge E7) or the length of the lower edge (eighth edge E8) of the small window. The second distance is the distance between the lower left corner of the widget (seventh corner CN 7) and the upper edge of the preview area (third edge E3). The fourth distance is the distance between the upper left corner of the widget (fifth corner CN5 and the lower edge of the preview area (eighth edge E8).

As shown in a of fig. 14E, the widget is located at the upper left portion of the preview area, and the first distance m is greater than the second distance n and greater than the fourth distance q. When the terminal device receives an operation of switching the widget pattern at the interface shown in a of fig. 14E, the terminal device controls the position of the lower left corner of the widget to be unchanged, extends the widget up to the upper edge, and enters the interface shown in b of fig. 14E.

When the upper edge of the small window intersects with the upper edge of the preview area, the terminal device lengthens the small window in the opposite direction to the first preset direction, shortens the small window toward the left edge (first edge E1) of the preview area, and enters the interface shown by c in fig. 14E.

The adjustment strategy for switching from vertical to horizontal may be: the terminal equipment controls the sixth preset corner position of the small window to be unchanged, controls the small window to extend along the third preset direction and controls the small window to shorten along the fourth preset direction. When the edge of the small window is intersected with the edge of the preview area in the third preset direction, the terminal equipment controls the small window to extend along the opposite direction of the third preset direction and to shorten along the fourth preset direction.

In this embodiment of the present application, the extension of the third preset direction in the direction parallel to the short sides in the vertical screen display state may be left or right. The second preset direction is a direction perpendicular to the short side in the vertical screen display state, and can be upward or downward.

In a possible implementation manner one, when the first distance is smaller than or equal to the third distance, the terminal device controls the fifth preset corner position of the small window to be unchanged, controls the small window to extend along the third preset direction and controls the small window to shorten along the fourth preset direction; the first distance is the length of the long side of the small window, and the third distance is the distance between the fifth preset corner of the small window and the edge of the preview area in the second preset direction.

Illustratively, taking the sixth preset corner as the lower left corner (seventh corner CN 7) of the small window, the third preset direction is the right edge direction (second edge direction) of the preview area, the fourth preset direction is the lower edge direction (fourth edge direction) of the preview area as an example, and the first distance is the length of the small window, that is, the length of the left edge (fifth edge E5) or the length of the right edge (second edge E2) of the small window. The third distance is the distance between the lower left corner of the widget (seventh corner CN 7) and the right edge of the preview area (second edge E2).

As shown in a of fig. 15A, the widget is located at the lower left portion of the preview area, and the first distance m is smaller than the third distance p. When the terminal device receives an operation of switching the widget style at the interface a in fig. 15A, the terminal device controls the position of the lower left corner of the widget to be unchanged, to extend toward the right edge (second edge E2) of the preview area, to shorten toward the lower edge (fourth edge E4) of the preview area, and to enter the interface b in fig. 15A.

In a second possible implementation manner, when the first distance is greater than the third distance, the terminal device controls the fifth preset corner position of the small window to be unchanged, controls the small window to extend along the third preset direction and controls the small window to shorten along the fourth preset direction; when the edge of the small window is intersected with the edge of the preview area in the third preset direction, the small window is controlled to extend along the reverse direction of the third preset direction and to shorten along the fourth preset direction.

As shown in a of fig. 15B, the widget is located at the lower right portion of the preview area, and the first distance m is greater than the third distance p. When the terminal device receives an operation of switching the widget style at the interface a in fig. 15B, the terminal device controls the position of the lower left corner of the widget to be unchanged, to extend toward the right edge of the preview area, to shorten toward the lower edge (fourth edge E4) of the preview area, and to enter the interface B in fig. 15B.

When the right edge of the widget intersects the right edge of the preview area, the terminal device controls the widget to extend in the opposite direction of the third preset direction and to shorten in the fourth preset direction, and the terminal device enters the interface shown by c in fig. 15B.

The adjustment strategy for switching the vertical direction to the horizontal direction can be as follows: when the first distance is smaller than or equal to the third distance, the terminal equipment controls the sixth preset corner position of the small window to be unchanged, controls the small window to extend along the third preset direction and controls the small window to shorten along the fourth preset direction. Or when the first distance is greater than the third distance, the corner position of the small window adjacent to the sixth preset corner in the third preset direction is unchanged, and the small window is controlled by the terminal device to be lengthened along the opposite direction of the third preset direction and shortened along the fourth preset direction.

The case where the first distance is less than or equal to the third distance may be as shown in fig. 15A. The case where the first distance is greater than the third distance will be described below with reference to fig. 15C.

As shown in a of fig. 15C, the widget is located at the right portion of the preview area, and the first distance m is greater than the third distance p. When the terminal device receives an operation of switching the widget style at the interface a in fig. 15C, the terminal device controls the position of the lower right corner of the widget to be unchanged, to extend toward the left edge of the preview area, to shorten toward the lower edge of the preview area, and to enter the interface b in fig. 15C.

Therefore, the situation that display is incomplete caused by switching the small window mode can be reduced, and user experience is improved.

The embodiment of the application also provides a scene of switching the horizontal and vertical screens by linkage of the preview area and the small window, as shown in fig. 16:

the terminal device is illustratively shown as a in fig. 16, where the terminal device is horizontally placed, the preview area is in a landscape preview state, and the widget is also in a landscape preview state. When the terminal device detects that it is vertically placed, the preview area of the terminal device switches Cheng Shubing the preview state and the widget also switches to a vertical screen preview as shown by b in fig. 16.

It can be understood that when the display screen of the terminal device is switched from horizontal to vertical, the preview area is switched from horizontal to vertical. The preview picture of the preview area is adapted to the change of the preview area, and correspondingly, the preview picture changes from horizontal to vertical, i.e. from horizontal to vertical to horizontal to the horizontal to vertical.

The small window is unchanged relative to the preview area, and the preview picture of the small window is still a clipping picture of the corresponding position of the preview area. However, the change of the placement state of the small window is represented by switching from a horizontal screen to a vertical screen, and the preview picture in the small window is changed from horizontal to vertical, namely, from horizontal length to vertical length, and from horizontal length to vertical length to horizontal length.

Icons of the first switching control and/or icons of the second switching control can be switched into a vertical screen preview mode.

When the terminal equipment switches the transverse screen and the vertical screen, the acceleration sensor can be detected to obtain acceleration values of X, Y and Z directions. The terminal equipment calculates the rotation angle based on the acceleration value, so as to determine the transverse screen state and the vertical screen state of the terminal equipment. When the terminal equipment detects that the terminal equipment rotates, the preview area is switched in a horizontal-vertical mode, and the positions and states of part of icons are correspondingly changed. For example, when the preview area is switched from a landscape screen to a portrait screen, the content (e.g., flash control, etc.) displayed on the terminal device interface may be rotated accordingly.

It can be understood that when the terminal equipment is placed vertically, the mode and strategy for adjusting the specification of the small window are similar to the mode and strategy for adjusting the specification of the small window when the terminal equipment is placed horizontally; the strategy of switching the small window style based on the control when the terminal equipment is vertically placed is similar to the strategy of switching the small window style based on the control when the terminal equipment is horizontally placed, and the detailed description is omitted.

It can be understood that, in the recording process, the terminal device may also adjust the position, specification, etc. of the small window, and the adjustment process and strategy thereof are similar to those in the preview case, which will not be described herein.

It can be appreciated that the shape of the small window is rectangular, and the small window can also be square, round or any other shape, and the shape of the small window is not limited in the embodiment of the present application.

On the basis of the above embodiments, the embodiments of the present application provide a video recording method. Fig. 17 is a schematic flow chart of a video recording method according to an embodiment of the present application.

As shown in fig. 17, the recording method may include the steps of:

s1701, the terminal equipment displays a first interface.

In the embodiment of the application, the first interface comprises a first window and a second window; the first window displays a picture acquired by the first camera in real time, the picture comprises a first object, and the second window displays a part of pictures related to the first object in the first window.

It is understood that the first interface may be a preview interface (for example, an interface shown by a in fig. 3B) provided with a tracking target, or may be a recording interface (for example, an interface shown by a in fig. 3C) provided with a tracking target. The first window may be understood as the preview area or the recording area above; the picture acquired by the first camera in real time can be understood as the preview picture or the recording picture; the second window may be understood as the small window above; the screen displayed in the second window may be understood as a tracking screen corresponding to the tracking target.

S1702, at a first moment, the terminal device detects that a first object is displayed at a first position of a first window, and a second window displays a part of a picture related to the first object at the first position in the first window.

S1703, at a second moment, the terminal device detects that the first object is displayed at the second position of the first window, and the second window displays a part of pictures related to the first object at the second position of the first window.

In this embodiment, when the first switching control and the second switching control are triggered, the small window style may be switched from horizontal to vertical or from vertical to horizontal. The landscape display state can be understood as the landscape display in the above; the landscape display state can be understood as the vertical display in the above.

The form of the first switch control, the second switch control, etc. may be referred to in the relevant description above. The manner in which the first switch control and the second switch control are triggered and the switching schematic can be described with reference to fig. 13A and 13B, which are not limited herein.

For example, the small window switching may be as shown in fig. 15C.

It will be appreciated that the process of enlarging the small window may refer to the description related to fig. 11C, which is not repeated here.

The recording method according to the embodiment of the present application has been described above, and the apparatus for performing the method according to the embodiment of the present application is described below. As shown in fig. 18, fig. 18 is a schematic structural diagram of a video recording apparatus according to an embodiment of the present application, where the video recording apparatus may be a terminal device in an embodiment of the present application, or may be a chip or a chip system in the terminal device.

As shown in fig. 18, the video recording apparatus 2100 may be used in a communication device, a circuit, a hardware component, or a chip, and includes: a display unit 2101, and a processing unit 2102. Wherein the display unit 2101 is used for supporting the step of displaying performed by the video recording apparatus 2100; the processing unit 2102 is configured to support the recording apparatus 2100 to execute steps of information processing.

In a possible implementation, the recording apparatus 2100 may also include a communication unit 2103. Specifically, the communication unit is configured to support the video recording apparatus 2100 to perform the steps of transmitting data and receiving data. The communication unit 2103 may be an input or output interface, a pin or circuit, or the like.

In a possible embodiment, the video recording apparatus may further include: a storage unit 2104. The processing unit 2102 and the storage unit 2104 are connected by a line. The memory unit 2104 may include one or more memories, which may be one or more devices, circuits, or means for storing programs or data. The storage unit 2104 may exist independently and is connected to the processing unit 2102 provided in the video recording apparatus via a communication line. The memory unit 2104 may also be integrated with the processing unit 2102.

The storage unit 2104 may store computer-executed instructions of the method in the terminal apparatus to cause the processing unit 2102 to execute the method in the above-described embodiment. The storage unit 2104 may be a register, a cache, a RAM, or the like, and the storage unit 2104 may be integrated with the processing unit 2102. The storage unit 2104 may be a read-only memory (ROM) or other type of static storage device that may store static information and instructions, and the storage unit 2104 may be independent of the processing unit 2102.

The embodiment of the present application provides a terminal device, which may also be called a terminal (terminal), a User Equipment (UE), a Mobile Station (MS), a Mobile Terminal (MT), or the like. The terminal device may be a mobile phone, a smart television, a wearable device, a tablet (Pad), a computer with wireless transceiving function, a Virtual Reality (VR) terminal device, an augmented reality (augmented reality, AR) terminal device, a wireless terminal in industrial control (industrial control), a wireless terminal in unmanned driving (self-driving), a wireless terminal in teleoperation (remote medical surgery), a wireless terminal in smart grid (smart grid), a wireless terminal in transportation safety (transportation safety), a wireless terminal in smart city (smart city), a wireless terminal in smart home (smart home), or the like.

The terminal device includes: comprising the following steps: a processor and a memory; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to cause the terminal device to perform the method described above.

The embodiment of the application provides a terminal device, and the structure is shown in fig. 1. The memory of the terminal device may be configured to store at least one program instruction, and the processor is configured to execute the at least one program instruction, so as to implement the technical solution of the foregoing method embodiment. The implementation principle and technical effects are similar to those of the related embodiments of the method, and are not repeated here.

The embodiment of the application provides a chip. The chip comprises a processor for invoking a computer program in a memory to perform the technical solutions in the above embodiments. The principle and technical effects of the present invention are similar to those of the above-described related embodiments, and will not be described in detail herein.

The embodiment of the application provides a computer program product, which enables a terminal device to execute the technical scheme in the embodiment when the computer program product runs on electronic equipment. The principle and technical effects of the present invention are similar to those of the above-described related embodiments, and will not be described in detail herein.

The embodiment of the application provides a computer readable storage medium, on which program instructions are stored, which when executed by a terminal device, cause the terminal device to execute the technical solution of the above embodiment. The principle and technical effects of the present invention are similar to those of the above-described related embodiments, and will not be described in detail herein. The methods described in the above embodiments may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. If implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer readable media can include computer storage media and communication media and can include any medium that can transfer a computer program from one place to another. The storage media may be any target media that is accessible by a computer.

The computer readable medium may include RAM, ROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium targeted for carrying or storing the desired program code in the form of instructions or data structures and may be accessed by a computer. Also, any connection is properly termed a computer-readable medium. For example, if the software is transmitted from a website, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, digital subscriber line (Digital Subscriber Line, DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk and disc, as used herein, includes optical disc, laser disc, optical disc, digital versatile disc (Digital Versatile Disc, DVD), floppy disk and blu-ray disc where disks usually reproduce data magnetically, while discs reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.

Embodiments of the present application are described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processing unit of a general purpose computer, special purpose computer, embedded processor, or other programmable apparatus to produce a machine, such that the instructions, which execute via the processing unit of the computer or other programmable apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

The foregoing detailed description of the invention has been presented for purposes of illustration and description, and it should be understood that the foregoing is by way of illustration and description only, and is not intended to limit the scope of the invention.

Claims

1. A method of recording video, the method comprising:

the terminal equipment displays a first interface, wherein the first interface comprises a first window and a second window; the first window displays a picture acquired by the first camera in real time, the picture comprises a first object, and the second window displays a part of pictures related to the first object in the first window;

at a first moment, the terminal device detects that the first object is displayed at a first position of the first window, and the second window displays a part of pictures related to the first object at the first position in the first window;

at a second moment, the terminal device detects that the first object is displayed at a second position of the first window, and the second window displays a part of pictures related to the first object at the second position in the first window.

2. The method of claim 1, wherein a first switching control is included in the first window and/or a second switching control is included in the second window;

the method further comprises the steps of:

when the second window is in a horizontal screen display state at a third moment, responding to the triggering operation of the first switching control or the second switching control, and switching the second window into a vertical screen display state by the terminal equipment;

or when the second window is in the vertical screen display state at the third moment, responding to the triggering operation of the first switching control or the second switching control, and switching the second window into the horizontal screen display state by the terminal equipment.

3. The method according to claim 2, wherein the method further comprises:

when the second window is switched from the horizontal screen display state to the vertical screen display state, the terminal equipment controls the second window to extend along a first preset direction and shorten along a second preset direction based on a vertical switching positioning point, wherein the first preset direction is a direction parallel to the short side in the horizontal screen display state, and the second preset direction is a direction perpendicular to the short side in the horizontal screen display state.

4. A method according to claim 3, wherein the first preset direction is vertically upwards, the second preset direction is horizontally leftwards, and the vertical switching anchor point is a lower left corner vertex of the second window;

the terminal equipment controls the second window to extend along a first preset direction and shorten along a second preset direction based on a vertical switching positioning point, and the terminal equipment comprises:

when the first distance is smaller than or equal to a second distance, the terminal equipment controls the position of the left lower corner vertex of the second window to be unchanged, controls the second window to be vertically and upwards prolonged and horizontally and leftwards shortened, the first distance is the length of the long side of the second window, and the second distance is the distance between the left lower corner vertex of the second window and the upper edge of the first window;

or when the first distance is larger than the second distance, the terminal equipment controls the position of the top point of the lower left corner of the second window to be unchanged, controls the second window to vertically extend upwards, and when the upper edge of the second window is intersected with the upper edge of the first window, controls the second window to vertically extend downwards.

5. The method of claim 2, wherein the terminal device is pre-configured with a plurality of vertical handover anchor points, the method further comprising:

when the first distance is smaller than or equal to the distance between a first vertical switching positioning point and the edge of the window in the corresponding extending direction, the terminal equipment controls the second window to extend along a first preset direction corresponding to the first vertical switching positioning point and shorten along a second preset direction based on the first vertical switching positioning point, and the first vertical switching positioning point is any one of a plurality of vertical switching positioning points; wherein the first distance is the length of the long side of the second window;

when the first distance is greater than the distance between each vertical switching positioning point and the edge of the first window in the corresponding extending direction, the terminal equipment controls the second window to extend along the first preset direction corresponding to the second vertical switching positioning point based on the second vertical switching positioning point, shortens along the second preset direction, and is any one of the vertical switching positioning points.

6. The method of claim 5, wherein the vertical switch anchor point comprises a lower left corner vertex of the second window and an upper left corner vertex of the second window; the first preset direction corresponding to the left lower corner vertex of the second window is vertical upwards, the first preset direction corresponding to the left upper corner vertex of the second window is vertical downwards, and the second preset direction is a horizontal-left vertical switching positioning point and a vertical switching positioning point;

when the first distance is smaller than or equal to the distance between the first vertical switching positioning point and the edge of the window in the corresponding extending direction, the terminal device controls the second window to extend along a first preset direction corresponding to the first vertical switching positioning point and shorten along a second preset direction based on the first vertical switching positioning point, and the first vertical switching positioning point is any one of the vertical switching positioning points, including:

Or when the first distance is greater than the second distance and is smaller than or equal to a fourth distance, the terminal equipment controls the position of the top left corner vertex of the second window to be unchanged, controls the second window to vertically extend downwards and horizontally shorten leftwards, and the fourth distance is the distance between the top left corner vertex and the lower edge of the first window;

when the first distance is greater than the distance between each vertical switching positioning point and the edge of the first window in the respective corresponding extending direction, the terminal device controls the second window to extend along a first preset direction corresponding to the second vertical switching positioning point based on a second vertical switching positioning point, shortens along a second preset direction, and the second vertical switching positioning point is any one of the vertical switching positioning points, and comprises:

when the first distance is larger than the second distance and larger than the fourth distance, the terminal equipment controls the position of the vertex of the lower left corner of the second window to be unchanged, controls the second window to vertically extend upwards and horizontally shorten leftwards, and when the upper edge of the second window intersects with the upper edge of the first window, the terminal equipment controls the second window to vertically extend downwards and horizontally shorten leftwards.

7. The method according to any one of claims 1-6, further comprising:

when the second window is switched from the vertical screen display state to the horizontal screen display state, the terminal equipment controls the second window to extend along a third preset direction and shorten along a fourth preset direction based on a horizontal switching positioning point, wherein the third preset direction is a direction parallel to the short side in the vertical screen display state, and the fourth preset direction is a direction perpendicular to the short side in the vertical screen display state.

8. The method of claim 7, wherein the step of determining the position of the probe is performed,

the fourth preset direction is vertical downward, and the transverse switching positioning point comprises a left lower corner vertex of the second window and a right lower corner vertex of the second window;

the terminal equipment controls the second window to extend along a third preset direction and shorten along a fourth preset direction based on a transverse switching positioning point, and the terminal equipment comprises:

when the first distance is smaller than or equal to a third distance, the terminal equipment controls the position of the left lower corner vertex of the second window to be unchanged, controls the second window to horizontally extend to the right and vertically shorten downwards, wherein the first distance is the length of the long side of the second window, and the third distance is the distance between the left lower corner vertex of the second window and the right edge of the first window;

And when the first distance is larger than the third distance, the terminal equipment controls the position of the top point of the right lower angle of the second window to be unchanged, and controls the second window to horizontally extend leftwards and vertically shorten downwards.

9. The method according to any one of claims 1-8, further comprising:

the terminal equipment detects a shrinking or enlarging operation for the second window;

and in response to the operation of reducing or enlarging the second window, the terminal equipment reduces or enlarges the size of the second window.

10. The method of claim 9, wherein the step of determining the position of the substrate comprises,

when the terminal equipment reduces or enlarges the size of the second window, the content of the second picture is unchanged, or the content of the second picture is in proportion to the size of the second window.

11. The method according to claim 9 or 10, wherein the terminal device reduces or enlarges the size of the second window, comprising:

when the terminal device enlarges the size of the second window and the second window intersects with the edge of the first window in the enlarging direction, the terminal device changes the enlarging direction of the second window.

12. The method of claim 11, wherein the step of determining the position of the probe is performed,

in the process of amplifying the size of the second window by the terminal device,

if the second window intersects with the edge of the first window in the amplifying direction corresponding to the Mth positioning point, the terminal equipment determines an Mth+1th positioning point, wherein the Mth+1th positioning point is positioned on the edge of the second window intersecting with the first window in the amplifying direction and is adjacent to the Mth positioning point, and the amplifying direction corresponding to the Mth positioning point is the diagonal direction of the Mth positioning point;

the terminal equipment controls the position of the (M+1) th positioning point to be unchanged, the second window is amplified along the amplifying direction corresponding to the (M+1) th positioning point, and the amplifying direction corresponding to the (M+1) th positioning point is the diagonal direction of the (M+1) th positioning point.

13. The method according to claim 11 or 12, wherein when the terminal device enlarges the size of the second window and the second window intersects an edge of the first window in an enlargement direction, the terminal device determines an enlargement direction of the replaced second window based on the edge of the second window intersecting the first window in the enlargement direction, comprising:

When the terminal equipment enlarges the size of the second window, the terminal equipment controls the vertex of the lower left corner of the second window to be unchanged, and enlarges the second window along the direction of the upper right corner;

when the upper edge of the second window is intersected with the upper edge of the first window, the terminal equipment controls the vertex of the upper left corner of the second window to be unchanged, and enlarges the second window along the direction of the lower right corner;

when the right edge of the second window is intersected with the right edge of the first window, the terminal equipment controls the vertex of the right upper corner of the second window to be unchanged, and enlarges the second window along the left lower corner direction.

14. The method according to any one of claims 1-13, further comprising:

the terminal equipment detects a moving operation for the second window;

and responding to the movement operation for the second window, and moving the second window along the movement track of the movement operation by the terminal equipment.

15. The method according to any one of claims 1 to 14, wherein,

when the terminal equipment displays the first interface, a focus focused by the first camera is on the first object;

At the first moment, a focal point of the first camera is focused on the first object;

at the second moment, the first camera focuses on the first object.

16. A terminal device, characterized in that the terminal device comprises a processor for invoking a computer program in memory for performing the method according to any of claims 1-15.

17. A computer readable storage medium storing computer instructions which, when run on a terminal device, cause the terminal device to perform the method of any of claims 1-15.