CN111526232B

CN111526232B - Camera control method based on double-screen terminal and double-screen terminal

Info

Publication number: CN111526232B
Application number: CN202010401236.1A
Authority: CN
Inventors: 高仁福; 周春萌
Original assignee: Hisense Mobile Communications Technology Co Ltd
Current assignee: Hisense Mobile Communications Technology Co Ltd
Priority date: 2020-05-13
Filing date: 2020-05-13
Publication date: 2021-07-06
Anticipated expiration: 2040-05-13
Also published as: CN111526232A

Abstract

The invention discloses a camera control method based on a double-screen terminal and the double-screen terminal, which are used for controlling the starting of a camera on a back screen of the double-screen terminal. The double-screen terminal responds to the operation of scanning the identification code triggered by a user on the back screen, starts the front-facing camera to acquire a first preview image containing the identification code, and identifies the identification code; and responding to a screen switching instruction triggered by a user, starting the main screen, and if detecting the operation of scanning the identification code triggered on the main screen by the user, starting a second preview image which is acquired by the rear camera and contains the identification code, and identifying the identification code. According to the embodiment of the invention, when the operation of scanning the identification code is executed on the double-screen terminal, the camera to be started is determined from the system layer and is started, so that different camera starting mechanisms are provided for different screens of the double-screen terminal, the efficiency of executing the operation of scanning the identification code is improved, the range of the operation which can be executed by the back screen of the double-screen terminal is expanded, and the user experience is improved.

Description

Camera control method based on double-screen terminal and double-screen terminal

Technical Field

The invention relates to the technical field of terminal display, in particular to a camera control method based on a double-screen terminal and the double-screen terminal.

Background

Along with the popularization of intelligent communication terminals, the requirements of people on the communication terminals are improved, and in order to better meet the requirements of users, the types of the intelligent communication terminals are more and more. The double-screen terminal is an intelligent terminal with two display screens, and a main screen of the double-screen terminal is a color screen, so that the daily use requirements of users are met, and the double-screen terminal can be used for taking pictures, watching videos and the like; the back of the body screen is the china ink screen, and the china ink screen possess the feel of paper book, can be used to read books, browse news etc. and eyeshield and china ink screen power consumption is lower, and it is long when can prolonging cell-phone use, and the design at double screen terminal has promoted the user experience of user when using intelligent communication terminal.

With the application of the dual-screen terminal becoming more and more extensive, the back screen of the dual-screen terminal can be used for not only reading scenes such as books and browsing news, but also photographing scenes, scanning scenes and the like, and under the scenes, a camera needs to be started on the back screen to realize the functions. At present, a control method for starting a camera on a back screen of a double-screen terminal does not exist.

Disclosure of Invention

The invention provides a camera control method based on a double-screen terminal and the double-screen terminal, which are used for controlling the starting of a camera on a back screen of the double-screen terminal.

According to a first aspect of exemplary embodiments, there is provided a dual screen terminal including: the system comprises a main screen, a back screen, a front camera, a rear camera and a processor, wherein the main screen and the back screen are arranged oppositely;

the processor is configured to respond to an operation of scanning an identification code triggered by a user on the back screen, start the front-facing camera and identify the identification code in a first preview image which is acquired by the front-facing camera and contains the identification code;

responding to a screen switching instruction triggered by a user, starting the main screen, starting the rear camera if detecting the operation of scanning an identification code triggered on the main screen by the user, and identifying the identification code in a second preview image which is acquired by the rear camera and contains the identification code;

the front camera is configured to acquire the first preview image;

the back screen is configured to display a first preview image which is acquired by the front camera and contains an identification code;

the rear camera is configured to acquire the second preview image;

the main screen is configured to display a second preview image which is acquired by the rear camera and contains an identification code.

In the above embodiment, when the operation of scanning the identification code triggered by the user on the back screen of the dual-screen terminal is responded, the dual-screen terminal starts the front-facing camera to acquire the first preview image containing the identification code, and after the screen is switched, if the operation that the user triggers the scanning of the identification code on the main screen of the dual-screen terminal is detected, the dual-screen terminal starts the rear-facing camera to acquire the second preview image containing the identification code. In the camera control method based on the double-screen terminal provided by the embodiment of the invention, a user does not need to manually execute the camera switching operation, the camera to be started is determined from the system layer and is started, different camera starting mechanisms are provided for different screens of the double-screen terminal, and the efficiency of executing the operation of scanning the identification code is improved; and the range of operations that can be executed by the back screen of the dual-screen terminal is expanded, for example, the back screen can also execute the operation of scanning the identification code by starting the front camera, so that the user experience is improved.

In some exemplary embodiments, the first preview image is an image acquired by the front camera without being subjected to mirror image processing.

In the embodiment of the invention, the image which is acquired by the camera and is not subjected to mirror image processing is used as the first preview image, so that the content contained in the first preview image is ensured to be the same as the spatial scene observed by a user, and the requirement of the user is met.

In some exemplary embodiments, the first preview image is an image obtained by performing a secondary mirror processing on an original image acquired by the front camera.

In the embodiment of the invention, under the condition that the processing mechanism of the front camera is not changed, the image subjected to the primary mirror image processing is subjected to secondary mirror image processing, and the image subjected to the secondary mirror image processing is taken as a first preview image, so that the content contained in the first preview image is ensured to be the same as the spatial scene observed by a user, and the requirement of the user is met.

According to a second aspect of the exemplary embodiments, there is provided a dual screen terminal including: the system comprises a main screen, a back screen, a front camera, a rear camera and a processor, wherein the main screen and the back screen are arranged oppositely;

the processor is configured to respond to a face recognition operation triggered by a user on the back screen, start the rear camera and recognize a face in a third preview image which contains the face and is acquired by the rear camera;

responding to a screen switching instruction triggered by a user, starting the main screen, if detecting the operation of face recognition triggered on the main screen by the user, starting the front-facing camera, and recognizing the face in a fourth preview image which is acquired by the front-facing camera and contains the face;

the rear camera is configured to acquire the third preview image;

the back screen is configured to display a third preview image which is acquired by the rear camera and contains a human face;

the front camera is configured to acquire the fourth preview image;

the main screen is configured to display a fourth preview image containing a human face and acquired by the front camera.

In the above embodiment, when the operation of the face recognition triggered by the user on the back screen of the dual-screen terminal is responded, the dual-screen terminal starts the rear-facing camera to acquire the third preview image containing the face, and after the screen is switched, if the operation of the face recognition triggered by the user on the main screen of the dual-screen terminal is detected, the dual-screen terminal starts the front-facing camera to acquire the fourth preview image containing the face. In the camera control method based on the dual-screen terminal provided by the embodiment of the invention, a user does not need to manually execute the camera switching operation, the camera to be started is determined from the system layer and is started, different camera starting mechanisms are provided for different screens of the dual-screen terminal, the efficiency of executing the operation of face recognition is improved, and the user experience is improved.

In some exemplary embodiments, the third preview image is an image obtained by performing mirror image processing on an original image acquired by the rear camera.

In the embodiment of the invention, the original image containing the face collected by the rear camera is subjected to mirror image processing once to obtain the third preview image containing the face, so that the moving direction of the terminal is ensured to be the same as the moving direction of the space scene where the user is located and collected by the rear camera, and the terminal meets the requirements of the user.

According to a third aspect of the exemplary embodiments, there is provided a camera control method based on a dual-screen terminal, including:

responding to an operation of scanning an identification code triggered by a user on a back screen, starting a front camera arranged on a main screen, displaying a first preview image which is acquired by the front camera and contains the identification code on the back screen, and identifying the identification code in the first preview image;

responding to a screen switching instruction triggered by a user, starting the main screen by the double-screen terminal, starting a rear camera arranged on the back screen if the operation of scanning an identification code triggered on the main screen by the user is detected, displaying a second preview image containing the identification code and acquired by the rear camera on the main screen, and identifying the identification code in the second preview image.

According to a fourth aspect of the exemplary embodiments, there is provided a camera control method based on a dual-screen terminal, including:

responding to a face recognition operation triggered by a user on a back screen, starting a rear camera arranged on the back screen, displaying a third preview image which is acquired by the rear camera and contains a face on the back screen, and recognizing the face in the third preview image;

responding to a screen switching instruction triggered by a user, starting the main screen by the double-screen terminal, if detecting the operation of face recognition triggered by the user on the main screen, starting a front camera arranged on the main screen, displaying a fourth preview image containing a face and collected by the front camera on the main screen, and recognizing the face in the fourth preview image.

According to a fifth aspect of exemplary embodiments, there is provided a camera control apparatus based on a dual-screen terminal, configured to execute the camera control method based on a dual-screen terminal as described in the third aspect.

According to a sixth aspect of the exemplary embodiments, there is provided a camera control apparatus based on a dual-screen terminal, which is configured to execute the camera control method based on a dual-screen terminal according to the fourth aspect.

According to a seventh aspect of the exemplary embodiments, there is provided a computer storage medium having stored therein computer program instructions, which when run on a computer, cause the computer to execute the camera control method based on a dual-screen terminal as described in the third aspect.

According to an eighth aspect of the exemplary embodiments, there is provided a computer storage medium having stored therein computer program instructions, which when run on a computer, cause the computer to execute the camera control method based on a dual-screen terminal as described in the fourth aspect above.

On the basis of the common knowledge in the field, the above preferred conditions can be combined randomly to obtain the preferred embodiments of the application.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1 is a schematic structural diagram of a communication terminal according to an embodiment of the present invention;

fig. 2 is a schematic diagram illustrating a software architecture of a communication terminal according to an embodiment of the present invention;

fig. 3 is a schematic diagram illustrating a user interface of a communication terminal provided by an embodiment of the present invention;

fig. 4 exemplarily shows an image display interface acquired by default starting of the rear camera when the dual-screen terminal scans the identification code according to the embodiment of the present invention;

fig. 5 is a flowchart illustrating a camera control method based on a dual-screen terminal according to an embodiment of the present invention;

FIG. 6 is a schematic diagram illustrating an operation instruction of a user to trigger scanning of an identification code on a back screen of a dual-screen terminal according to an embodiment of the present invention;

fig. 7 is a schematic diagram illustrating a first preview image acquired by a front camera when a user triggers a scan identification code on a back screen of a dual-screen terminal according to an embodiment of the present invention;

FIG. 8 is a schematic diagram illustrating an operation instruction of a user to trigger scanning of an identification code on a home screen of a dual-screen terminal according to an embodiment of the present invention;

fig. 9 is a schematic diagram illustrating a second preview image acquired by a rear camera when a user triggers a scan identification code on a home screen of a dual-screen terminal according to an embodiment of the present invention;

fig. 10 is a flowchart illustrating another camera control method based on a dual-screen terminal according to an embodiment of the present invention;

FIG. 11 is a diagram illustrating an operation instruction of a user to trigger face recognition on a back screen of a dual-screen terminal according to an embodiment of the present invention;

fig. 12 is a schematic diagram illustrating a third preview image acquired by a rear camera when a user triggers face recognition on a back screen of a dual-screen terminal according to an embodiment of the present invention;

FIG. 13 is a diagram illustrating an operation instruction of a user to trigger face recognition on a home screen of a dual-screen terminal according to an embodiment of the present invention;

fig. 14 is a schematic diagram illustrating a fourth preview image acquired by a front camera when a user triggers face recognition on a home screen of a dual-screen terminal according to an embodiment of the present invention;

fig. 15 is a schematic diagram illustrating a position of a camera on a dual-screen terminal according to an embodiment of the present invention;

fig. 16 is a schematic diagram illustrating a preview image after a mirror processing when the front camera is started according to an embodiment of the present invention;

FIG. 17 is a diagram illustrating a mirroring process performed on an image according to an embodiment of the invention;

fig. 18 is a schematic structural diagram illustrating a dual-screen terminal according to an embodiment of the present invention;

fig. 19 is a schematic structural diagram illustrating another dual-screen terminal according to an embodiment of the present invention;

fig. 20 is a schematic structural diagram illustrating a camera control device based on a dual-screen terminal according to an embodiment of the present invention;

fig. 21 is a schematic structural diagram illustrating a camera control device based on a dual-screen terminal according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present application will be described in detail and clearly with reference to the accompanying drawings. In the description of the embodiments herein, "/" means "or" unless otherwise specified, for example, a/B may mean a or B; "and/or" in the text is only an association relationship describing an associated object, and means that three relationships may exist, for example, a and/or B may mean: three cases of a alone, a and B both, and B alone exist, and in addition, "a plurality" means two or more than two in the description of the embodiments of the present application.

In the following, the terms "first", "second" are used for descriptive purposes only and are not to be understood as implying or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of embodiments of the application, unless stated otherwise, "plurality" means two or more.

Some terms appearing herein are explained below:

1. in the embodiment of the invention, the term "Activity" is one of four most basic and most commonly used components in Android components. In an Android application, an Activity is usually a separate display interface, on which some icons can be displayed and events of a user can be monitored and processed to respond.

2. The term "color channel" in the embodiments of the present invention refers to a channel that stores color information of an image, which is called a color channel, and each color channel stores information of color elements in the image. The colors in all the color channels are superposed and mixed to generate the colors of the pixels in the image; the color channels comprise YUV color channels, wherein "Y" represents brightness, namely a gray-scale value, and "U" and "V" represent chroma, and are used for describing image color and saturation and specifying the color of a pixel; alternatively, the color channels may also include RGB color channels, R (red), G (green), B (blue) channels.

3. The term "application program" in the embodiments of the present invention may be simply referred to as an application, and refers to a computer program capable of performing one or more specific functions. It may have a visual display interface that enables interaction with the user, such as settings, electronic maps, WeChat, QQ, etc.; alternatively, the display may not have a visual display interface and may not interact with the user. Illustratively, applications can be divided into third party applications and system applications, wherein a third party application can be understood as a user-installed application, such as WeChat, Tencent chat software (QQ), nailing, etc.; system applications may be understood as applications that are preset by the operating system, such as settings, dials, information, etc.

4. The term "terminal" in the embodiment of the present invention refers to a device that can install various applications and can display an object provided in an installed application, and the terminal may be mobile or fixed. For example, a mobile phone, a tablet computer, various wearable devices, a vehicle-mounted device, a Personal Digital Assistant (PDA), a point of sale (POS), or other terminals capable of implementing the above functions.

Fig. 1 shows a schematic structural diagram of a communication terminal 100, and the communication terminal 100 shown in fig. 1 is a dual-screen terminal including two display units in the embodiment of the present invention.

The following describes an embodiment specifically taking the communication terminal 100 as an example. It should be understood that the communication terminal 100 shown in fig. 1 is only an example, and the communication terminal 100 may have more or less components than those shown in fig. 1, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

A block diagram of a hardware configuration of a communication terminal 100 according to an exemplary embodiment is exemplarily shown in fig. 1. As shown in fig. 1, the communication terminal 100 includes: radio Frequency (RF) circuit 110, memory 120, display unit 130, display unit 140, multiple cameras 150, sensor 160, audio circuit 170, Wireless Fidelity (Wi-Fi) module 180, processor 190, bluetooth module 191, and power source 1100.

The RF circuit 110 may be used for receiving and transmitting signals during information transmission and reception or during a call, and may receive downlink data of a base station and then send the downlink data to the processor 190 for processing; the uplink data may be transmitted to the base station. Typically, the RF circuitry includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.

The memory 120 may be used to store software programs and data. The processor 190 performs various functions of the communication terminal 100 and data processing by executing software programs or data stored in the memory 120. The memory 120 may include high speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device. The memory 120 stores an operating system that enables the communication terminal 100 to operate. The memory 120 may store an operating system and various application programs, and may also store codes for performing the methods described in the embodiments of the present application.

The display unit 130 may be used to receive input numeric or character information and generate signal input related to user settings and function control of the communication terminal 100, and particularly, the display unit 130 may include a touch screen 1301 disposed on the front surface of the communication terminal 100 and capable of collecting touch operations of a user thereon or nearby, such as clicking a button, dragging a scroll box, and the like.

The display unit 130 may also be used to display a Graphical User Interface (GUI) of information input by or provided to the user and various menus of the terminal 100. Specifically, the display unit 130 may include a display screen 1302 disposed on the front surface of the communication terminal 100. The display screen 1302 may be a color liquid crystal screen, and may be configured in the form of a liquid crystal display, a light emitting diode, or the like. The display unit 130 may be used to display various graphical user interfaces described herein.

The touch screen 1301 may cover the display screen 1302, or the touch screen 1301 and the display screen 1302 may be integrated to implement the input and output functions of the communication terminal 100, and after the integration, the touch screen may be referred to as a touch display screen for short. In the present application, the display unit 130 may display the application programs and the corresponding operation steps.

The display unit 140 may be used to receive input numeric or character information, generate signal input related to user settings and function control of the communication terminal 100, and specifically, the display unit 140 may include a touch screen 1401 disposed at the rear of the communication terminal 100, and may collect touch operations of a user thereon or nearby, such as clicking a button, dragging a scroll box, and the like.

The display unit 140 may also be used to display information input by the user or information provided to the user and a GUI for various menus of the terminal 100. Specifically, the display unit 140 may include a display screen 1402 provided on the rear surface of the communication terminal 100. The display 1402 may be an ink screen, and may be configured in the form of electronic ink, and the like. The display unit 140 may be used to display various graphical user interfaces described herein.

The touch panel 1401 may be overlaid on the display 1312, or the touch panel 1401 and the display 1402 may be integrated to implement an input and output function of the communication terminal 100, and after the integration, the touch panel may be referred to as a touch display for short.

The communication terminal 100 may also include a plurality of cameras 150, such as at least one front camera 1501 and at least one rear camera 1502, which may be used to capture still images or video. The object generates an optical image through the lens and projects the optical image to the photosensitive element. The photosensitive element may be a Charge Coupled Device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the processor 180 to be converted into a digital image signal, in the embodiment of the present invention, the front camera 1501 may be used to collect a first preview image containing an identification code when an operation of scanning the identification code is triggered on the back screen of the communication terminal 100, or may be used to collect a fourth preview image containing a human face when a human face recognition operation is triggered on the main screen of the communication terminal 100; and a rear camera 1502 which may be used to acquire a second preview image containing an identification code when the main screen of the communication terminal 100 triggers an operation of scanning the identification code, or may be used to acquire a third preview image containing a face when a face recognition operation is triggered on the back screen of the communication terminal 100.

The communication terminal 100 may further comprise at least one sensor 160, such as an acceleration sensor 161, a distance sensor 162, a fingerprint sensor 163, a temperature sensor 164. The communication terminal 100 may also be configured with other sensors such as a gyroscope, barometer, hygrometer, thermometer, infrared sensor, optical sensor, motion sensor, and the like.

The audio circuitry 170, speaker 171, microphone 172 may provide an audio interface between a user and the communication terminal 100. The audio circuit 170 may transmit the electrical signal converted from the received audio data to the speaker 171, and convert the electrical signal into a sound signal by the speaker 171 for output. The communication terminal 100 may also be provided with a volume button for adjusting the volume of the sound signal. On the other hand, the microphone 172 converts the collected sound signals into electrical signals, converts the electrical signals into audio data after being received by the audio circuit 170, and outputs the audio data to the RF circuit 110 to be transmitted to, for example, another terminal or outputs the audio data to the memory 120 for further processing. In the present application, the microphone 172 may capture the voice of the user.

Wi-Fi belongs to a short-distance wireless transmission technology, and the communication terminal 100 can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the Wi-Fi module 180, and provides wireless broadband internet access for the user.

The processor 190 is a control center of the communication terminal 100, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the communication terminal 100 and processes data by running or executing software programs stored in the memory 120 and calling data stored in the memory 120. In some embodiments, processor 190 may include one or more processing units; processor 190 may also integrate an application processor, which primarily handles operating systems, user interfaces, and applications, etc., with a baseband processor, which primarily handles wireless communications. It will be appreciated that the baseband processor described above may not be integrated into processor 190. In the present application, the processor 190 may run an operating system, an application program, a user interface display, and a touch response, and the processing method described in the embodiments of the present application. In addition, the processor 190 is coupled to the display unit 130 and the display unit 140.

And the Bluetooth module 191 is used for performing information interaction with other Bluetooth devices with Bluetooth modules through a Bluetooth protocol. For example, the communication terminal 100 may establish a bluetooth connection with a wearable electronic device (e.g., a smart watch) also equipped with a bluetooth module through the bluetooth module 191, so as to perform data interaction.

The communication terminal 100 also includes a power supply 1100 (such as a battery) that provides power to the various components. The power supply may be logically coupled to processor 190 through a power management system to manage charging, discharging, and power consumption functions through the power management system. The communication terminal 100 may also be configured with power buttons for powering the terminal on and off, and for locking the screen.

Fig. 2 is a block diagram of a software configuration of the communication terminal 100 according to the embodiment of the present invention.

The layered architecture divides the software into several layers, each layer having a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, an application layer, an application framework layer, an Android runtime (Android runtime) and system library, and a kernel layer from top to bottom.

The application layer may include a series of application packages.

As shown in fig. 2, the application package may include applications such as camera, gallery, calendar, phone call, map, navigation, WLAN, bluetooth, music, video, short message, etc.

The application framework layer provides an Application Programming Interface (API) and a programming framework for the application program of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 2, the application framework layers may include a window manager, content provider, view system, phone manager, resource manager, notification manager, and the like.

The window manager is used for managing window programs. The window manager can obtain the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

The view system includes visual controls such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, the display interface including the short message notification icon may include a view for displaying text and a view for displaying pictures.

The phone manager is used to provide a communication function of the communication terminal 100. Such as management of call status (including on, off, etc.).

The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and the like.

The notification manager enables the application to display notification information in the status bar, can be used to convey notification-type messages, can disappear automatically after a short dwell, and does not require user interaction. Such as a notification manager used to inform download completion, message alerts, etc. The notification manager may also be a notification that appears in the form of a chart or scroll bar text at the top status bar of the system, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, text information is prompted in the status bar, a prompt tone is given, the communication terminal vibrates, and an indicator light flashes.

The Android Runtime comprises a core library and a virtual machine. The Android runtime is responsible for scheduling and managing an Android system.

The core library comprises two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. And executing java files of the application program layer and the application program framework layer into a binary file by the virtual machine. The virtual machine is used for performing the functions of object life cycle management, stack management, thread management, safety and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface managers (surface managers), Media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), and the like.

The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.

The media library supports a variety of commonly used audio, video format playback and recording, and still image files, among others. The media library may support a variety of audio-video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, and the like.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

The 2D graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The following describes exemplary work flows of software and hardware of the communication terminal 100 in connection with performing a scan of an identification code scene through a back screen of a dual-screen terminal.

When the touch screen 1401 receives a touch operation, a corresponding hardware interrupt is issued to the kernel layer. The kernel layer processes the touch operation into an original input event (including touch coordinates, a time stamp of the touch operation, and other information). The raw input events are stored at the kernel layer. And the application program framework layer acquires the original input event from the kernel layer and identifies the control corresponding to the input event. Taking the touch operation as a touch click operation, taking a control corresponding to the click operation as a control of a 'scan' icon of an application program as an example, the application program calls an opencamera () interface of an application framework layer, determines parameters of the opencamera () interface, and if the identifier of the front camera is 1, sets the parameters of the opencamera () interface to 1, then starts the driving of the front camera 1501 by calling an kernel layer, captures an image containing an identification code by the front camera 1501, performs secondary mirroring on the captured image containing the identification code by the kernel layer to obtain a first preview image, displays the first preview image on a display 1402 screen of the communication terminal 100, identifies the identification code contained in the first preview image, and displays the identification result to a user through the display screen 1402.

The communication terminal 100 in the embodiment of the present application may be a mobile phone, a tablet computer, a wearable device, a notebook computer, a television, and the like.

Fig. 3 is a schematic diagram for illustrating a user interface on a communication terminal (e.g., communication terminal 100 of fig. 1). In some implementations, a user can open a corresponding application by touching an application icon on the user interface, or can open a corresponding folder by touching a folder icon on the user interface.

At present, the back screen of the dual-screen terminal can be used for reading books, browsing news and the like, a user can also shoot on the back screen or scan codes on the back screen, and when the back screen of the dual-screen terminal is used for performing the above operation, a camera needs to be started to complete the operation. At present, when a camera is started, a double-screen terminal is consistent with a method for starting the camera by a common communication terminal.

For example, when a common communication terminal takes a picture, the rear camera of the terminal is started by default, but when a user takes a picture on the back screen of the dual-screen terminal, the rear camera of the dual-screen terminal is also started by default, the user needs to click a button for switching the cameras on the display interface of the back screen to switch the front camera and the rear camera, the process of starting the cameras is complicated, and the user experience is poor. For another example, when an ordinary terminal performs an operation of scanning an identification code, the back camera of the terminal is started by default, but when a user performs an operation of scanning an identification code on the back screen of the dual-screen terminal, the back camera of the dual-screen terminal is also started by default, as shown in fig. 4, when the user performs an operation of scanning an identification code through the back camera of the dual-screen terminal, a face image of the user is displayed on the back screen of the dual-screen terminal, but the face image is not a two-dimensional code, and a two-dimensional code scanning interface generally does not have a button for switching the cameras, so that the user needs to re-open the main screen of the dual-screen terminal to scan the two-dimensional code on the main screen, and the two-dimensional code cannot be scanned through the back screen. As can be seen from the above scenario, there is no control method for starting a camera on the back screen of a dual-screen terminal at present.

The embodiment of the invention provides a camera control method based on a double-screen terminal, which is used for controlling the starting of a camera on the double-screen terminal.

As shown in fig. 5, a flowchart of a camera control method based on a dual-screen terminal according to an embodiment of the present invention includes:

step S501, responding to an operation of scanning an identification code triggered by a user on a back screen, starting a front camera arranged on a main screen, displaying a first preview image which is acquired by the front camera and contains the identification code on the back screen, and identifying the identification code in the first preview image;

step S502, responding to a screen switching instruction triggered by a user, starting a main screen by the double-screen terminal, if detecting the operation of scanning an identification code triggered on the main screen by the user, starting a rear camera arranged on a back screen, displaying a second preview image containing the identification code and acquired by the rear camera on the main screen, and identifying the identification code in the second preview image.

In the camera control method based on the dual-screen terminal provided by the embodiment of the invention, when the operation of triggering the scanning identification code on the back screen of the dual-screen terminal by a user is responded, the dual-screen terminal starts the front camera to acquire a first preview image containing the identification code, and after the screen is switched, if the operation of triggering the scanning identification code on the main screen of the dual-screen terminal by the user is detected, the dual-screen terminal starts the rear camera to acquire a second preview image containing the identification code. In the camera control method based on the double-screen terminal provided by the embodiment of the invention, a user does not need to manually execute the camera switching operation, the camera to be started is determined from the system layer and is started, different camera starting mechanisms are provided for different screens of the double-screen terminal, and the efficiency of executing the operation of scanning the identification code is improved; and the range of operations that can be executed by the back screen of the dual-screen terminal is expanded, for example, the back screen can also execute the operation of scanning the identification code by starting the front camera, so that the user experience is improved.

It should be noted that the operation of scanning the identification code in the embodiment of the present invention is only used for describing the camera control method of the dual-screen terminal of the present invention, and the operation of scanning the identification code in the embodiment of the present invention may be any operation that needs to start a form rear camera, where the form rear camera in the embodiment of the present invention refers to a camera disposed on a screen opposite to a currently activated screen, for example, if the currently activated screen is a main screen, the form rear camera refers to a rear camera disposed on a back screen; if the currently activated screen is a back screen, the shape rear camera is a front camera arranged on the main screen. In the embodiment of the present invention, the operation of scanning the identification code may also be a "photographing operation", a "video recording operation", or a "photographing search operation", and the above-mentioned operation that needs to start the form rear camera is only an example and does not limit the protection scope of the embodiment of the present invention, and any operation that needs to start the form rear camera is within the protection scope of the embodiment of the present invention.

In implementation, a user clicks an icon corresponding to an operation of scanning an identification code on a back screen of the dual-screen terminal to trigger the operation of scanning the identification code, the dual-screen terminal determines a camera to be started according to the operation triggered by the user, and if the operation triggered by the user is the operation of scanning the identification code, the front camera is started.

As shown in fig. 6, a user clicks a "scan" icon in an application program display interface on a back screen of the dual-screen terminal to trigger an operation instruction for scanning the identification code, the dual-screen terminal responds to the operation instruction for scanning the identification code triggered by the user, determines information of a screen on which the user triggers the operation instruction, determines that an operation for scanning the identification code is executed on the back screen, starts a front-facing camera of the dual-screen terminal, acquires a first preview image containing the identification code, which is acquired by the front-facing camera and shown in fig. 7, and identifies the identification code in the first preview image, and displays an identification result to the user, thereby completing the operation for scanning the identification code. In implementation, the identification result may be public number business card information, and the user pays attention to the identified public number and the like according to the displayed public number business card information.

In the embodiment of the invention, the identification code can be a two-dimensional code or a bar code.

And after the double-screen terminal detects a screen switching instruction triggered by a user, responding to the screen switching instruction to switch the activated screen, and switching from starting the back screen of the double-screen terminal to starting the main screen of the double-screen terminal.

In implementation, the screen switching instruction triggered by the user may be to press power keys corresponding to different display screens, for example, a main screen and a back screen on the dual-screen terminal respectively correspond to one power key, the currently activated screen is the back screen of the dual-screen terminal, when it is detected that the user presses the power key corresponding to the main screen, a screen triggering instruction of the user is determined, and the dual-screen terminal responds to the screen switching instruction started by the user to start the main screen of the dual-screen terminal.

After the double-screen terminal starts a main screen, detecting the operation triggered by a user on the main screen, if detecting that the operation of scanning an identification code is triggered by an icon corresponding to the operation of clicking the identification code on the main screen by the user, determining a camera to be started according to the operation triggered by the user by the double-screen terminal, and if the operation triggered by the user is the operation of scanning the identification code, starting a rear camera.

As shown in fig. 8, a user clicks a "scan code unlock" icon in an application display interface on a home screen of the dual-screen terminal to trigger an operation instruction for scanning an identification code, the dual-screen terminal responds to the operation instruction for scanning the identification code triggered by the user, determines information of a screen on which the user triggers the operation instruction, determines that an operation for scanning the identification code is performed on the home screen, starts a rear camera of the dual-screen terminal, acquires a second preview image containing the identification code, which is acquired by the rear camera and is shown in fig. 9, identifies the identification code in the second preview image, and displays an identification result to the user to complete the operation for scanning the identification code. In implementation, the identification result may be that an unlocking result is displayed to the user, and the user determines that the unlocking is successful or the unlocking is failed according to the displayed unlocking result.

In addition, when the common single-screen terminal performs the operation of face recognition, the front camera of the terminal is started by default, but when the user performs the operation of face recognition on the back screen of the double-screen terminal, the front camera of the double-screen terminal is also started by default, an image acquired by the front camera of the double-screen terminal does not contain a face image of the user, the user is required to re-open the main screen of the double-screen terminal, the face recognition operation is performed on the main screen, and the face recognition cannot be realized on the back screen of the double-screen terminal.

The embodiment of the invention also provides a camera control method based on the double-screen terminal, which is used for controlling the starting of the camera on the double-screen terminal.

As shown in fig. 10, a flowchart of a camera control method based on a dual-screen terminal according to an embodiment of the present invention includes:

step S1001, responding to a face recognition operation triggered by a user on a back screen, starting a rear camera arranged on the back screen, displaying a third preview image which is acquired by the rear camera and contains a face on the back screen, and recognizing the face in the third preview image;

step S1002, responding to a screen switching instruction triggered by a user, starting a main screen by the double-screen terminal, if detecting a face recognition operation triggered on the main screen by the user, starting a front camera arranged on the main screen, displaying a fourth preview image containing a face and collected by the front camera on the main screen, and recognizing the face in the fourth preview image.

In the camera control method based on the dual-screen terminal provided by the embodiment of the invention, when the operation of face recognition triggered by a user on the back screen of the dual-screen terminal is responded, the dual-screen terminal starts the rear camera to acquire a third preview image containing a face, and after the screen is switched, if the operation of triggering the face recognition on the main screen of the dual-screen terminal by the user is detected, the dual-screen terminal starts the front camera to acquire a fourth preview image containing the face. In the camera control method based on the dual-screen terminal provided by the embodiment of the invention, a user does not need to manually execute the camera switching operation, the camera to be started is determined from the system layer and is started, different camera starting mechanisms are provided for different screens of the dual-screen terminal, the efficiency of executing the operation of face recognition is improved, and the user experience is improved.

It should be noted that the operation of face recognition in the embodiment of the present invention is only used for explaining the camera control method of the dual-screen terminal of the present invention, and the operation of face recognition in the embodiment of the present invention may be any operation that needs to start a form front-facing camera, which refers to a camera that is set on a currently activated screen in the embodiment of the present invention, for example, if the currently activated screen is a main screen, the form front-facing camera refers to a front-facing camera that is set on the main screen; if the currently activated screen is a back screen, the form front camera is a rear camera arranged on the back screen. In the embodiment of the present invention, the operation of face recognition may also be a self-photographing operation, a video call operation, a face unlocking operation, a face payment operation, and the like, and the above-mentioned operation that requires to start the form front camera is only an example and does not limit the protection scope of the embodiment of the present invention, and any operation that requires to start the form front camera is within the protection scope of the embodiment of the present invention.

In the implementation, a user clicks an icon corresponding to the face recognition operation on a back screen of the dual-screen terminal to trigger the face recognition operation, the dual-screen terminal determines a camera to be started according to the user-triggered operation, and if the user-triggered operation is the face recognition operation, the rear camera is started.

As shown in fig. 11, a user clicks a "face payment" icon in an application display interface on a back screen of the dual-screen terminal to trigger an operation instruction of face recognition, the dual-screen terminal responds to the operation instruction of face recognition triggered by the user, determines information of a screen on which the user triggers the operation instruction, determines that the operation of face recognition is performed on the back screen, starts a rear camera of the dual-screen terminal, acquires a third preview image including a face, which is acquired by the rear camera and is shown in fig. 12, identifies the face in the third preview image, and displays an identification result to the user, thereby completing the operation of face recognition. In implementation, the recognition result may be that a face payment result is displayed to the user, and the user determines that the payment is successful or the payment is failed according to the displayed face payment result.

After the double-screen terminal starts a main screen, detecting the operation triggered by a user on the main screen, if the operation that the user clicks an icon corresponding to the operation of face unlocking on the main screen to trigger face recognition is detected, determining a camera to be started according to the operation triggered by the user by the double-screen terminal, and if the operation triggered by the user is the operation of face recognition, starting the front-facing camera.

As shown in fig. 13, the "reading" application program is provided with an application lock, the unlocking mode is face recognition unlocking, when a user clicks an icon of the "reading" application program on a main screen of the dual-screen terminal, an operation instruction of face recognition is triggered, the dual-screen terminal responds to the operation instruction of face recognition triggered by the user, determines screen information of the operation instruction triggered by the user, determines that the operation of face recognition is executed on the main screen, starts a front camera of the dual-screen terminal, acquires a fourth preview image containing a face, which is acquired by the front camera and is shown in fig. 14, identifies the face in the fourth preview image, and displays the identification result to the user, thereby completing the operation of face recognition. In practice, the recognition result may be that the unlocking of the application lock is successful and the home page of the "reading" application program is entered.

In the camera control method based on the dual-screen terminal provided by the embodiment of the invention, when the dual-screen terminal determines the camera to be started according to different operations triggered by the user on different screens, an optional implementation manner is that the dual-screen terminal determines the started camera according to the operation type of the operation triggered by the user and the corresponding relationship between the camera types.

When determining the operation type of the operation triggered by the user, the dual-screen terminal creates Activity according to the operation of clicking a display page icon by the user, and determines the operation type of the operation triggered by the user according to the created Activity name, wherein the operation type of the operation triggered by the user corresponds to the Activity name one by one, and the operation type of the operation triggered by the user is assumed to be the Activity name corresponding to the scanning two-dimensional code, namely Activity 1; the operation type of the operation triggered by the user is 'photographing', and the corresponding Activity name is Activity 2; the action name corresponding to the action type of the operation triggered by the user, namely self-timer, is action 3; the operation type of the operation triggered by the user is that the Activity name corresponding to the video call is Activity 4; the operation type of the operation triggered by the user is the Activity name corresponding to the face unlocking, namely Activity5 and the like. For example, the application a and the application B may both perform an operation of scanning a two-dimensional code, but the operation type of the operation of scanning a two-dimensional code of the application a is different from the operation type of the operation of scanning a two-dimensional code of the application B, the operation of scanning a two-dimensional code is triggered in the application a, the name of the correspondingly created Activity is Activity6, the operation of scanning a two-dimensional code is triggered in the application B, and the name of the correspondingly created Activity is Activity 7.

And the double-screen terminal determines to execute the operation triggered by the user on the back screen, and after the operation triggered by the user needs to start the camera for auxiliary execution, the camera needing to be started is determined according to the corresponding relation between the pre-stored operation type and the camera type.

An optional implementation manner is that the dual-screen terminal determines a camera type corresponding to the type of operation triggered by the user according to a corresponding relationship between the operation type corresponding to the back screen and the camera type; if the camera type corresponding to the type of the operation triggered by the user is a front-facing camera, starting the front-facing camera of the double-screen terminal; and if the camera type corresponding to the type of the operation triggered by the user is the rear camera, starting the rear camera of the double-screen terminal.

Specifically, the dual-screen terminal configures a corresponding relationship between an operation type corresponding to the back screen and a camera type in advance, and after the operation type of the operation triggered by the user is determined according to the Activity name of the operation triggered by the user, the started camera type is determined according to the corresponding relationship between the operation type of the operation triggered by the user and the camera type.

It should be noted that, the pre-configured corresponding relationship in the dual-screen terminal further includes a corresponding relationship between an operation type corresponding to the home screen and a camera type, and if the dual-screen terminal determines the operation type of the operation triggered by the user on the home screen, the camera type corresponding to the type of the operation triggered by the user is determined according to the corresponding relationship between the operation type corresponding to the home screen and the camera type. That is to say, in the camera control method based on the dual-screen terminal provided by the embodiment of the present invention, the camera start rules corresponding to the main screen and the back screen of the dual-screen terminal are respectively pre-configured, and when the dual-screen terminal determines that the operation that the camera needs to be started is executed on the main screen, the started camera is selected according to the camera start rule corresponding to the main screen; and when the double-screen terminal determines to execute the operation of starting the camera on the back screen, selecting the started camera according to the camera starting rule corresponding to the back screen.

In implementation, the correspondence between the operation type corresponding to the back screen and the camera type, which are configured in advance by the dual-screen terminal, is shown in table 1:

type of operation	Camera type
		Scanning two-dimensional code	Front camera
Photographing device	Front camera
		Self-timer	Rear camera
Video call	Rear camera
		Face recognition	Rear camera

TABLE 1

In implementation, the correspondence between the operation type and the camera type corresponding to the back screen as shown in table 1 may be stored in the form of an identifier when storing, and the correspondence shown in table 1 is merely an example. In the storage, the operation type may be stored in the form of an Activity name, and the camera type may be stored in the form of a camera identifier, for example, the identifier of the front camera is 0, the identifier of the rear camera is 1, and the like.

After the operation type of the operation triggered by the user is determined according to the Activity name of the operation triggered by the user, the type of the camera needing to be started is determined according to the corresponding relation between the operation type of the operation triggered by the user and the type of the camera. If the operation type of the operation triggered by the user on the back screen is determined to be 'scanning two-dimensional code', and the camera type corresponding to the operation type of the operation triggered by the user is determined to be a front camera according to the corresponding relation shown in the table 1, starting the front camera of the double-screen terminal; if the operation type of the operation triggered by the user on the back screen is determined to be 'face recognition', and the camera type corresponding to the operation type of the operation triggered by the user is determined to be the rear camera according to the corresponding relation shown in the table 1, the rear camera of the double-screen terminal is started.

In implementation, after a camera to be started is selected, parameters of an opencamera () interface in a frame layer can be set according to an identifier of the camera, so that the camera is started. For example, it is determined that a target camera to be started is a front-facing camera, the dual-screen terminal sets a parameter of an opencamera () interface to 0, and starts the front-facing camera.

The embodiment of the invention also provides a mode for selecting the camera to be started by the double-screen terminal according to the type of the operation triggered by the user and the corresponding relationship between the operation type and the camera type.

In an optional implementation manner, the dual-screen terminal determines a camera type corresponding to the type of operation triggered by the user according to a corresponding relationship between the operation type corresponding to the main screen and the camera type; if the camera type corresponding to the type of the operation triggered by the user is a front camera, starting a rear camera of the double-screen terminal; and if the camera type corresponding to the type of the operation triggered by the user is the rear camera, starting the front camera of the double-screen terminal.

Specifically, the dual-screen terminal configures a corresponding relationship between an operation type corresponding to the main screen and a camera type in advance, and determines the started camera type according to the corresponding relationship between the operation type of the operation triggered by the user and the camera type after determining the operation type of the operation triggered by the user according to the Activity name of the operation triggered by the user.

It should be noted that, the correspondence preset in the dual-screen terminal may include a correspondence between an operation type corresponding to the main screen and a camera type, and if the dual-screen terminal determines the operation type of the operation triggered by the user on the main screen or the back screen, the camera type corresponding to the operation type triggered by the user is determined according to the correspondence between the operation type corresponding to the main screen and the camera type.

In implementation, if the dual-screen terminal determines that the operation triggered by the user is executed on the main screen, the camera type corresponding to the type of the operation triggered by the user is determined according to the corresponding relation between the operation type corresponding to the main screen and the camera type; if the camera corresponding to the type of the operation triggered by the user is a front-facing camera, starting the front-facing camera; and if the camera corresponding to the type of the operation triggered by the user is the rear camera, starting the rear camera. If the double-screen terminal determines that the operation triggered by the user is executed on the back screen, determining the camera type corresponding to the operation type triggered by the user according to the corresponding relation between the operation type corresponding to the main screen and the camera type; if the camera corresponding to the type of the operation triggered by the user is a front camera, starting a rear camera; and if the camera corresponding to the type of the operation triggered by the user is the rear camera, starting the front camera.

That is to say, in the camera control method based on the dual-screen terminal provided by the embodiment of the present invention, a camera start rule corresponding to a main screen of the dual-screen terminal is pre-configured, and when the dual-screen terminal determines that an operation triggered by a user is executed on the main screen, the started camera is selected according to the camera start rule corresponding to the main screen; and when the double-screen terminal determines that the operation triggered by the user is executed on the back screen, determining the camera type corresponding to the operation type according to the camera starting rule corresponding to the main screen, switching according to the determined camera type, and starting the camera of the switched type.

In implementation, the correspondence between the operation type corresponding to the home screen and the camera type, which are pre-configured in the dual-screen terminal, is shown in table 2:

type of operation	Camera type
		Scanning two-dimensional code	Rear camera
Photographing device	Rear camera
		Self-timer	Front camera
Video call	Front camera
		Face recognition	Front camera

TABLE 2

In implementation, the correspondence between the operation type and the camera type corresponding to the home screen as shown in table 2 may be stored in the form of an identifier when storing, and the correspondence shown in table 2 is merely an example. In the storage, the operation type may be stored in the form of an Activity name, and the camera type may be stored in the form of a camera identifier, for example, the identifier of the front camera is 0, the identifier of the rear camera is 1, and the like.

After the operation type of the operation triggered by the user is determined according to the Activity name of the operation triggered by the user, the type of the camera needing to be started is determined according to the corresponding relation between the operation type of the operation triggered by the user and the type of the camera. If the operation type of the operation triggered by the user on the back screen is determined to be scanning the two-dimensional code, and the camera type corresponding to the operation type of the operation triggered by the user is determined to be the rear camera according to the corresponding relation shown in the table 2, starting the front camera of the double-screen terminal; if the operation type of the operation triggered by the user on the back screen is determined to be 'face recognition', and the camera type corresponding to the operation type of the operation triggered by the user is determined to be a front camera according to the corresponding relation shown in the table 2, a rear camera of the double-screen terminal is started.

Similarly, assuming that the operation type of the operation triggered by the user on the main screen is determined to be 'scanning two-dimensional code', starting a rear camera of the double-screen terminal according to the corresponding relation shown in the table 2; assuming that the operation type of the operation triggered by the user on the main screen is determined to be 'face recognition', the front-facing camera of the dual-screen terminal is started according to the corresponding relation shown in the table 2.

In implementation, the dual-screen terminal determines a camera type corresponding to an operation type of an operation triggered by a user according to a preset rule for starting the camera, sets a parameter of an opencamera () interface in a frame layer according to an identifier of the determined camera type, and switches the parameter of the opencamera () interface when the operation triggered by the user is determined to be executed on a back screen according to information of a screen triggering an operation instruction, so as to start the corresponding camera. For example, if the type of the camera determined according to the operation type is a rear camera, the parameter of the opencamera () interface is 1, and when the dual-screen terminal determines to execute an operation on the back screen according to the information of the screen triggering the operation instruction, the parameter of the opencamera () interface is switched to 0, and the front camera is started.

It should be noted that the dual-screen terminal provided in the embodiment of the present invention includes at least one front-facing camera and at least one rear-facing camera, and the started cameras may be one or more of the front-facing cameras or one or more of the rear-facing cameras, and may be set according to specific situations, which is not limited in the embodiment of the present invention. Fig. 15 is a schematic diagram of a position of a camera on a dual-screen terminal according to an embodiment of the present invention, where the camera disposed on a main screen side of the dual-screen terminal is a front-facing camera, and the camera disposed on a back screen side of the dual-screen terminal is a rear-facing camera.

In the embodiment of the invention, when a user triggers the operation of scanning the identification code on the back screen of the double-screen terminal, the double-screen terminal starts the front-facing camera, collects a first preview image containing the identification code through the front-facing camera, and displays the first preview image on the back screen of the double-screen terminal. When a user triggers the operation of face recognition on the back screen of the double-screen terminal, the double-screen terminal starts the rear camera, collects a third preview image containing a face through the rear camera, and displays the third preview image on the back screen of the double-screen terminal.

In the embodiment of the invention, the first preview image can be an image which is acquired by a front camera and is not subjected to mirror image processing; or, the first preview image may be an image obtained by performing secondary mirroring on an original image acquired by the front-facing camera. The third preview image is an image obtained by carrying out mirror image processing on an original image acquired by the rear camera.

Generally, when a front-facing camera is used, a preview image is obtained by mirroring an image acquired by the front-facing camera, and for a back screen of a dual-screen terminal, a rear-facing camera is a front-facing camera and a front-facing camera is a rear-facing camera. Therefore, when the operation of scanning the identification code is executed on the back screen, the front camera of the double-screen terminal is started, the image acquired by the front camera does not need to be subjected to mirror image processing, and when the operation of face recognition is executed on the back screen, the rear camera of the double-screen terminal is started, the image acquired by the rear camera needs to be subjected to mirror image processing once.

In addition, generally, because the main screen of the dual-screen terminal may also call the front-facing camera to perform operations such as face recognition, if the system of the dual-screen terminal automatically performs a primary mirroring process on the image collected by the front-facing camera when the front-facing camera is started, the front-facing camera is started when the system of the dual-screen terminal performs an operation of scanning the identification code on the back screen, the image after the primary mirroring process that is automatically performed may be subjected to a secondary mirroring process again, which is equivalent to the operation of scanning the identification code on the back screen, the front-facing camera is started to perform a secondary mirroring process on the image collected by the front-facing camera, and the image after the secondary mirroring process is the same as the image collected by the front-facing camera that is not subjected to the mirroring process.

In the embodiment of the present invention, it is assumed that a system of the dual-screen terminal automatically performs primary mirroring on an image acquired by the front camera, and if secondary mirroring is not performed, when an operation of scanning an identification code is performed on a back screen of the dual-screen terminal, a preview image displayed on the back screen of the dual-screen terminal is shown in fig. 16, which is opposite to the identification code observed by a user, so that secondary mirroring needs to be performed on the image acquired by the front camera.

When the image is subjected to mirror image processing, an image symmetry axis can be determined according to the image size, the storage data corresponding to any two pixel points which are symmetrical left and right about the symmetry axis are exchanged, and the image subjected to mirror image processing is generated according to the storage data corresponding to each pixel point after the storage data exchange.

Specifically, the camera of the dual-screen terminal converts the acquired optical signal into an electrical signal, and then transmits the electrical signal to the processor of the dual-screen terminal to be converted into image storage data, where the data form of the digital storage data may be YUV-form storage data or RGB-form storage data, and the embodiment of the present invention is not limited specifically.

Supposing that image storage data acquired by the camera is storage data in a YUV form, after a symmetry axis of an image is determined, storage data of YUV three color channels corresponding to pixels which are symmetrical left and right about the symmetry axis are exchanged, and an image after mirror image processing is generated according to the storage data corresponding to each pixel after exchange. When the image shown in fig. 17 is subjected to mirror image processing, the symmetry axis of the image is determined, and data of the YUV three channels corresponding to any two pixel points symmetrical about the symmetry axis shown in fig. 17 are exchanged to realize mirror image processing.

The mirror image processing algorithm provided by the embodiment of the invention performs mirror image processing on each frame of image in the acquired preview image stream, consumes about 10ms, ensures the frame rate to be more than 25 and avoids the phenomenon of blocking. And displaying the preview image on a back screen of the double-screen terminal, wherein the preview image is obtained after carrying out secondary mirror image processing on the image acquired by the front camera, and the displayed preview image is as shown in fig. 7.

It should be noted that, in the embodiment of the present invention, the method for determining a preview image by performing mirroring on an image is merely an example, and does not limit the protection scope of the embodiment of the present invention, and in implementation, a tool such as OpenCV may be used to determine a preview image by performing mirroring or rotation on an image.

Based on the same inventive concept, the embodiment of the invention also provides a dual-screen terminal, and as the problem solving principle of the dual-screen terminal and the camera control method based on the dual-screen terminal of the embodiment of the invention, the implementation of the dual-screen terminal can refer to the implementation of the method, and repeated parts are not described again.

As shown in fig. 18, an embodiment of the present invention provides a dual-screen terminal, which can be applied to perform an operation of scanning an identification code, and includes: the system comprises a main screen 1801, a back screen 1802, a front camera 1803, a rear camera 1804 and a processor 1805, wherein the main screen 1801 and the back screen 1802 are arranged oppositely;

the processor 1805 is configured to execute the camera control method based on the dual-screen terminal as described above;

the front camera 1803 is configured to acquire a first preview image;

the back screen 1802 is configured to display a first preview image containing an identification code acquired by the front camera 1803;

the rear camera 1804 is configured to acquire a second preview image;

the home screen 1801 is configured to display a second preview image containing an identification code acquired by the rear camera 1804.

As shown in fig. 19, an embodiment of the present invention provides a dual-screen terminal, which can be applied to perform operations of face recognition, including: a main screen 1901 and a back screen 1902 which are arranged oppositely, a front camera 1903 arranged on the main screen, a rear camera 1904 arranged on the back screen, and a processor 1905;

the processor 1905 is configured to execute the dual-screen terminal-based camera control method as described above;

the rear camera 1904 is configured to capture a third preview image;

the back screen 1902 is configured to display a third preview image containing a human face, which is acquired by the rear camera 1904;

the front camera 1903 is configured to capture a fourth preview image;

the home screen 1901 is configured to display a fourth preview image containing a human face acquired by the front camera 1903.

As shown in fig. 20, an embodiment of the present invention provides a camera control device based on a dual-screen terminal, including:

a first starting module 2001, configured to start a front-facing camera disposed on a main screen in response to an operation of scanning an identification code triggered by a user on a back screen, display a first preview image containing the identification code and acquired by the front-facing camera on the back screen, and identify the identification code in the first preview image;

the second starting module 2002 is configured to start the main screen in response to a screen switching instruction triggered by a user, start a rear camera disposed on the back screen if an operation of scanning an identification code triggered on the main screen by the user is detected, display a second preview image containing the identification code and acquired by the rear camera on the main screen, and identify the identification code in the second preview image.

As shown in fig. 21, an embodiment of the present invention provides a camera control device based on a dual-screen terminal, including:

a third starting module 2101 configured to respond to a face recognition operation triggered by a user on a back screen, start a rear camera disposed on the back screen, display a third preview image including a face acquired by the rear camera on the back screen, and recognize the face in the third preview image;

a fourth starting module 2102, configured to start the main screen in response to a screen switching instruction triggered by a user, start a front camera disposed on the main screen if an operation of face recognition triggered by the user on the main screen is detected, display a fourth preview image including a face, acquired by the front camera, on the main screen, and recognize the face in the fourth preview image.

Embodiments of the present application also provide a computer-readable medium, on which a computer program is stored, which when executed by a processor implements the steps of any of the methods described above.

Since the communication terminal and the computer storage medium in the embodiment of the present invention may be applied to the processing method, reference may also be made to the above method embodiment for obtaining technical effects, and details of the embodiment of the present invention are not described herein again.

Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.

While specific embodiments of the invention have been described above, it will be appreciated by those skilled in the art that these are by way of example only, and that the scope of the invention is defined by the appended claims. Various changes and modifications to these embodiments may be made by those skilled in the art without departing from the spirit and scope of the invention, and these changes and modifications are within the scope of the invention.

Claims

1. A dual screen terminal, comprising: the system comprises a main screen, a back screen, a front camera, a rear camera and a processor, wherein the main screen and the back screen are arranged oppositely;

the front camera is configured to acquire the first preview image;

the rear camera is configured to acquire the second preview image;

2. The dual-screen terminal of claim 1, wherein the first preview image is an image captured by the front-facing camera without being mirrored.

3. The dual-screen terminal of claim 1, wherein the first preview image is an image obtained by performing a secondary mirroring process on an original image collected by the front-facing camera.

4. A dual screen terminal, comprising: the system comprises a main screen, a back screen, a front camera, a rear camera and a processor, wherein the main screen and the back screen are arranged oppositely;

the rear camera is configured to acquire the third preview image;

the front camera is configured to acquire the fourth preview image;

5. The dual-screen terminal of claim 4, wherein the third preview image is an image obtained by performing mirror image processing on an original image acquired by the rear camera.

6. A camera control method based on a double-screen terminal is characterized by comprising the following steps:

7. The method of claim 6, wherein the first preview image is an image acquired by the front-facing camera without mirroring; or

The first preview image is an image obtained by performing secondary mirror image processing on an original image acquired by the front camera.

8. A camera control method based on a double-screen terminal is characterized by comprising the following steps:

responding to a screen switching instruction triggered by a user, starting a main screen by the double-screen terminal, if detecting the operation of face recognition triggered by the user on the main screen, starting a front camera arranged on the main screen, displaying a fourth preview image containing a face and collected by the front camera on the main screen, and recognizing the face in the fourth preview image.

9. The method of claim 8, wherein the third preview image is an image obtained by mirroring an original image acquired by the rear camera once.

10. A computer storage medium having computer program instructions stored therein which, when run on a computer, cause the computer to perform the method of any of claims 6 to 9.