CN111279681A

CN111279681A - Square photo shooting control method and device with redisplay function

Info

Publication number: CN111279681A
Application number: CN201780096377.3A
Authority: CN
Inventors: 张学熙
Original assignee: Shenzhen Transsion Communication Co Ltd
Current assignee: Shenzhen Transsion Communication Co Ltd
Priority date: 2017-08-30
Filing date: 2017-08-30
Publication date: 2020-06-12
Also published as: WO2019041165A1

Abstract

A square photo shooting control method with redisplay is used for a mobile phone with a rectangular photo preview function, and comprises the following steps: s1, when the mobile phone operating system receives a photographing instruction of a user, acquiring a rectangular preview of the current scene through a camera of the mobile phone and displaying the rectangular preview on a screen; s2, shielding the rectangular preview image displayed on the screen, and enabling the visible area on the screen to be square; s3, moving the square area by the user to select and confirm the shot image; and S4, the display content of the screen is not changed, and the background clips the image shot in S3 according to the area selected in S2 and displays the image back to the screen. The invention does not need waiting time caused by switching different photographing modes in the photographing process, and the next photographing can be carried out without switching the exit-reentry function of the preview image, thereby greatly shortening the waiting time of the user in the photographing process and improving the user experience.

Description

Square photo shooting control method and device with redisplay function

Technical Field

The invention relates to the field of mobile phone application, in particular to a square photo shooting control method and device with a playback function.

Background

A telephone is an old and new communication tool. Since the first wired telephone of bell invention in 1876, the telephone has experienced a development in the last 150 years. Telephone communication service has advanced into thousands of households, and becomes an indispensable important tool for national economic construction, social life and information exchange of people. In 1972, the parent Martin Cooper of mobile phones began to study mobile phones until the first truly mobile phone emerged in 1983, and communication tools began to change from open to ground. Over thirty years, mobile phones have evolved from the oldest "brick and tile" to modern smart phones that include multiple functions. Telephone technology and services have changed dramatically, with the location of communications moving from fixed to mobile. The rapid development of mobile communication gradually develops the mobile phone from the heavy and monotonous appearance and simple and unique function into the light, thin and small appearance and various functions, so that the modern life rhythm is faster and faster, and people can not leave the mobile phone more and more.

The first generation mobile phone (1G) is an analog mobile phone, and the functions of the mobile phone in the analog mobile phone era are often limited to only the call function, and are limited by various aspects of technology and materials, so that the style is quite single and is lack of change.

In 1994, wu ji, a minister of the time-minded post and telecommunications, handed in the first GSM phone in china historically using nokia 2110. China began the era of second generation cell phones (2G). The GSM network in the 2G era is a digital network, and a mobile phone can transmit a small amount of text data in addition to a basic call function. The function "short message" thus starts to appear. The short message function makes up the defect that people are inconvenient to answer or cannot be connected, and improves the use experience of mobile phone users.

In the 1G era, the screen of the mobile phone is also a black and white screen, and the backlight is only green. The 2G era is an era in which the screen of a mobile phone has changed greatly. In the last ninth and ninth century, due to the development of LED technology, the backlight source of the mobile phone screen begins to appear different colors such as white, blue and orange. But the screen of the mobile phone is still single in color. After the new century, the liquid crystal technology and the OLED technology begin to rapidly develop, and the screen of the mobile phone starts a true color era. With the color screen as a technical foundation, the functions of the mobile phone are diversified, and various functions based on color pictures, such as multimedia messages, color desktops, and the like, are developed. The concept of cell phone photography was put into practice during this time. The maximum display color of the screen is up to 2000 ten thousand, the display effect is clear enough, and the screen can be used for playing high-quality videos or pictures, so that the photographing function becomes an integral part of the mobile phone.

The earliest mobile phone photographing function is only to simply implant the photographing function into the mobile phone, the photographing function is isolated from the operating system of the mobile phone itself, and the operation system of the mobile phone is only limited to control whether to photograph the camera, as shown in fig. 1. The mobile phone of the current operating system (for example, the classic Symbian system of saiban) cannot perform multiple operations such as multiple beautification and modification on the camera, or can only perform a few limited image color modification functions such as simple negative film, blue light, black and white, and the like. Otherwise, only the pictures taken by the camera can be processed as normal pictures in a separate graphic processing software. The use experience of the consumer is rather poor, the operation process is complicated, and time is wasted.

In the 3G era, the operating system of the mobile phone changes with the place covered, and the mobile phone can be installed with an application program (APP) by the user like a computer, so that a technical basis is provided for the real integration of the mobile phone and the photographing function.

At present, an android (android) system and an apple (ios) system are 2 big huge heads of mobile phone operating software. And the code of the mobile phone with the android system is open, so that no threshold limit is provided for programmers, and anyone can develop and install application software by himself, so that mutual embedding of an operating system and third-party software becomes a research and development trend.

As a common voice-controlled photographing function, as shown in fig. 2, a control connection between a microphone and a camera is established through a central controller, and a shutter can be controlled by speaking during photographing.

Processing of images is another common functional fusion. On one hand, in camera software, beautification, decoration and color brightness adjustment are directly performed on a shot picture, and on the other hand, in view of the requirements of third-party software such as WeChat software and QQ software on picture calling and using, all pictures or pictures need to provide a corresponding preview picture. Typical aspect ratios for photographs are typically 4: 3 (standard ratio) or 16: 9 (widening ratio). However, the ratio of the picture in the preview is not always the same as the ratio of the picture in the shooting, and a special preview function is required to process and extract the original picture.

At present, no matter a mobile phone of an android system or a mobile phone of an apple system, the photographing function of the mobile phone is very important in the mobile phone and is the place which can attract the eyes of customers, the richness of photographing and extending functions of a product and corresponding performance experience influence the sales volume of the product and the selection of the product by the customers to a great extent, and finally whether the customers use or continue to use the product is determined, so that the increase of the photographing function and the improvement of the performance are very important. In third-party applications, the positive photographing function gradually becomes popular, and 1: 1, and is different from the common 4: 3 and 16: the 9-mode photographing function has a very good experience, and plays a very important role in the product. As shown in fig. 3, it is the state of the art that the preview mode is converted into 1: 1 preview mode, wherein the steps S1 'and S2' are the steps that take the most time, are prone to cause the karton phenomenon, and most affect the user experience.

Disclosure of the invention

The invention aims to provide a square photo shooting control method and device with a redisplay function, which are applied to mobile terminals such as mobile phones and tablet computers, reduce the pause in preview switching, enrich the use choices of users and improve the use experience of the users.

A square photo shooting control method with redisplay is used for a mobile phone which originally has a rectangular photo preview function, and comprises the following steps:

s1, when the mobile phone operating system receives a photographing instruction of a user, acquiring a rectangular preview of the current scene through a camera of the mobile phone and displaying the rectangular preview on a screen;

s2, shielding the rectangular preview image displayed on the screen, and enabling the visible area on the screen to be square;

s3, moving the square area by the user to select and confirm the shot image;

and S4, the display content of the screen is not changed, and the background clips the image shot in S3 according to the area selected in S2 and displays the image back to the screen.

On the basis of the above square photograph shooting control method with redisplay, after the step S4, the method further includes:

s5, compressing the image obtained in the S4 to generate a jpeg/jpg image;

and S6, feeding the jpeg/jpg image data back to the mobile phone operating system, and storing the image data by the mobile phone operating system.

The method for controlling taking a square picture with a redisplay further comprises, before step S1:

and S0, confirming that the current photographing mode of the mobile phone is a square framing.

In the above square photo shooting control method with the redisplay, in the step S3, the shooting confirmation mode is a conventional key confirmation or a screen soft key touch confirmation or a voice control.

Further, in order to enhance the interaction between the photographing function and other applications in the mobile phone, based on the above square photo shooting control method with playback, the above square photo shooting control method with playback further includes, after the step S4:

and S7, if the third-party software needs to call the photo data, sending the processing result of S4 to the third party.

The method for controlling taking a square picture with a redisplay further includes, after the step S6:

s8, providing information of the current position, the current time and the current weather by third-party software, and recording the information in the attribute information of the jpeg/jpg image;

and S9, displaying the attribute information of the image in the jpeg/jpg image.

A photographing control device, which controls the photographing process by using any one of the above methods, comprises:

an image sensor for capturing an image to form a rectangular preview image as described in step S1;

the viewfinder is connected with the image sensor and selects a square view from the image sensor;

the shutter is connected with the viewfinder and confirms that the picture is taken;

the central processing unit cuts and stores the shot picture according to the area selected by the viewfinder;

the saved picture is displayed on the screen.

The photographing control device further comprises:

caching postview buffer in real time, wherein the postview buffer is used for caching the rectangular preview image obtained in the step S1;

a main buffer for storing the photo taken in step S3;

and the data buffer is used for storing the final square photo, and the square photo is obtained by cutting the photo in the main buffer according to the area selected by the viewfinder.

In the above photographing control apparatus, the viewfinder is a software viewfinder, the rectangular preview image is blocked by a black color block, a square view is provided in a visual effect, and a photograph is not actually cut.

A mobile phone comprises any one of the photographing control devices.

The invention has the advantages and beneficial effects that:

(1) better user experience;

(2) faster processing speed;

(3) more various picture forms.

The user does not need waiting time caused by switching different photographing modes in the photographing process, and the next photographing can be carried out without switching the exit-reentry function of the preview image, so that the waiting time of the user in the photographing process is greatly shortened, and the user experience is improved.

Brief description of the drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the contents of the embodiments of the present invention and the drawings without creative efforts.

Fig. 1 is a schematic structural diagram of a mobile phone photographing control method in the prior art.

Fig. 2 is a second schematic structural diagram of a mobile phone photographing control method in the prior art.

Fig. 3 is a flowchart of a conventional switching preview method.

Fig. 4 is a flowchart of switching the preview mode in the present invention.

Fig. 5 is a schematic structural diagram of a square photographing control manner according to the present invention.

FIG. 6 is a detailed structural diagram of a square photographing control method according to the present invention.

FIG. 7 is a diagram illustrating the use of a buffer according to the present invention.

Fig. 8 is a schematic structural diagram of a mobile phone in the present invention.

Best mode for carrying out the invention

The present invention will now be described in further detail by way of a detailed description of several preferred embodiments with reference to the accompanying drawings.

The square photo shooting control method with the redisplay shown in fig. 4 can be applied to a mobile phone which originally has a rectangular photo preview function, and of course, can also be used alone. The method adds a choice for taking square photos for the mobile phone, does not need the process of stopping first and then restarting in the prior art, and optimizes the program flow. The method comprises the following steps:

s1, when the mobile phone operating system receives a photographing instruction of a user, acquiring a rectangular preview of a current scene through the image sensor 31 of the mobile phone and displaying the rectangular preview on the screen 5;

s2, shielding the rectangular preview image displayed on the screen 5 to enable the visible area on the screen 5 to be square;

s3, moving the square area by the user to select and confirm the shot image;

s4, the display content of the screen 5 is not changed, and the background clips the image shot in S3 according to the area selected in S2 and displays the image back to the screen 5.

Further, in order to store the obtained image completely and accurately, the image displayed on the screen 5 needs to be stored in a local memory, and the storage form of the image is various, such as jpeg/jpg, gif, bmp, and the like. On the basis of the above square photograph shooting control method with redisplay, after the step S4, the method further includes:

s5, compressing the image obtained in the S4 to generate a jpeg/jpg image;

The hardware structure of the mobile phone supporting the steps S1-S5 is shown in FIG. 5. The central processing unit 2 in the mobile phone 1 can control the camera 3 to take a picture, and the control signal can be from a traditional key, or a virtual key from the screen 5, or a control signal from sound control software and Bluetooth control software. And the YUV format data obtained by taking a picture by the camera 3 is preferably stored in the buffer group 6, which is advantageous for speeding up the processing time of the picture. The image processor 21 processes the photo data in YUV format to obtain a square preview image, returns the square preview image to the buffer group 6 for buffering, and feeds the obtained image in jpeg/jpg format back to the central processor 2 to be stored by the central processor 2.

Further, in the prior art, all general mobile phones have a rectangular preview function. On the basis, the function of square photographing and previewing is added, namely, a branch is added in the original flow, the steps of judging and selecting the branch are certainly carried out before the branch enters, and the branch can be confirmed after the branch enters, as shown in fig. 4. The method for controlling taking a square picture with a redisplay further comprises, before step S1:

Furthermore, based on the fusion trend of various application software, the shutter diversification of the mobile phone camera can be supported not only on the use requirements of users but also on the technical level. Conventionally, a volume key or a power key or a confirmation inherent to a mobile phone is a first choice to serve as a shutter of a camera of the mobile phone, which is one of shutter choices that cannot be abandoned by various new technologies. On the basis, after the support of the mobile phone operating system is obtained, other input modes on the mobile phone can be used as a shutter of a mobile phone camera. The mobile phone camera and the third-party software use the mobile phone operating system as an interactive platform, as shown in fig. 5, the control signal of the third-party software is connected to the central processing unit 2, and is forwarded by the central processing unit 2 to control the shutter 33 of the camera 3. In the above square photo shooting control method with the redisplay, in the step S3, the shooting confirmation mode is a conventional key confirmation or screen 5 soft key touch confirmation or voice control or bluetooth control.

Further, in order to enhance the interaction between the photographing function and other applications in the mobile phone, on the basis of the above square photograph shooting control method with the display back, after the step S4, the method may further include the following steps:

It should be noted that, in step S4, the format of the picture taken is YUV format, which is a color coding method adopted by the european television system. The importance of using the YUV color space is that its luminance signal Y and chrominance signal U, V are separate. YUV formats are generally of two general types: a packed (packed) format and a planar (planar) format. The former stores YUV components in the same array, and usually several adjacent pixels form a macro-pixel (macro-pixel); and the latter uses three arrays to store the YUV three components separately, just like a three-dimensional plane. In any format, the digital information can be conveniently stored in various electronic devices, and the information quantity is complete and specific. Therefore, the YUV format data is selected when the data is transmitted to the third-party software in step S7, so that the most of the key information of original brightness, chrominance, etc. can be retained.

In order to increase the interest of the photo and help the user memorize the surrounding information of the photo taking, on the basis of the above square photo taking control method with the redisplay, after the step S6, the method may further include:

One preferred scheme is: and performing text editing and beautifying on the information such as the position, the time, the weather and the like, and displaying the information on the lower right corner of the jpeg/jpg image.

As shown in fig. 6, a photographing control device controls the photographing process by using any of the above methods, the image sensor 31 converts light and color information into electrical signals recognizable by a computer and digitalizes the electrical signals, and then the electrical signals are stored in the buffer group 6, the viewfinder 32 is a software viewfinder, a frame which is transparent in a square shape in the middle and opaque in black on two sides is manufactured by software and is superposed on the image sensor 31, so that the image seen by a user is a square.

The method comprises the following steps:

an image sensor 31 for capturing an image to form a rectangular preview image as described in step S1;

a viewfinder 32 connected to the image sensor 31 to select a square view therefrom;

a shutter 33 connected to the viewfinder 32 to confirm taking of a picture;

a central processing unit 2 for cutting and storing the shot picture according to the area selected by the viewfinder 32;

the saved picture is displayed back on the screen 5.

As shown in fig. 7, in the photographing control apparatus, the photos are cached in the buffer group 6 during the photographing process, and finally the square photos are fed back to the operating system after confirmation, and are stored in the system memory by the operating system. The method comprises the following steps:

a just-in-time buffer 61(postview buffer) for buffering the rectangular preview image obtained in step S1;

a main buffer 62(main buffer) for storing the photograph taken in step S3;

a data buffer 63(data buffer) for storing the final square photo, which is obtained by cropping the photo in the main buffer according to the area selected by the viewfinder 32.

Further, in the above photographing control apparatus, the viewfinder 32 is a software viewfinder, and the rectangular preview image is blocked by a black color block, so that a square view is provided in a visual effect, and a photograph is not actually cut.

Further, the photographing control device can be applied to various mobile terminals with operating systems, such as mobile phones, tablet computers or personal digital assistants, besides the mobile phone of the present invention. It should be noted that different specific programs may need to be written based on the different languages and file formats used by different operating systems, but this should not affect the generality of the method of the present invention. Just like the processing program compiled based on the android system, if the same function needs to be transplanted into the apple system, only adaptive modification is needed, and the modification is not regarded as inventive.

In the Android system, when running a camera application, interaction between a camera application layer, a camera application framework layer, a camera hardware abstraction layer, and a driver layer is generally required. The launcher searches for the resources of the camera application on the camera application layer, obtains a start entry, analyzes and executes the Java codes in the virtual machine in sequence, and calls the interface of the camera framework layer, the interface of the camera hardware abstraction layer and the drive interface of the drive layer in sequence in the execution process. The camera application layer is a program written in Java language and running on the camera virtual machine. Enabling the camera application requires starting the camera virtual machine. When a user takes a picture through the mobile terminal, the Camera application layer sends out a corresponding picture taking instruction (take picture instruction), and the picture taking instruction is transmitted to the Camera hardware abstraction layer through the Camera API and the Camera service of the Camera framework layer. When the camera hardware abstraction layer receives the photographing instruction, the camera is called to photograph, and the image data collected by the camera is stored by the driving layer.

The Camera hardware abstraction layer of the mobile terminal acquires image data acquired by the Camera from the drive layer, transmits the image data to the Camera application layer through the Camera API and the Camera service of the Camera frame layer, and generates and displays corresponding pictures according to the image data by the Camera application layer.

A mobile phone as shown in fig. 8 includes any one of the above-mentioned photographing control devices. The mobile phone 1 in this embodiment includes a central processing unit 2, a camera 3, a screen 5, a buffer group 6 and a memory. The central processor 2 comprehensively controls the camera 3, the screen 5, the buffer group 6 and the memory according to the method of the invention, so that the mutual fusion of different parts only occupies a few system time, thereby saving the system resources and the waiting time of customers.

The technical scheme of the invention is explained in detail by combining the attached drawings, and the invention provides a novel square photographing control method, which effectively avoids pause caused by switching previews by shielding the screen display to form a square view, improves the previewing speed, optimizes the photographing process and effect and further improves the use experience of users.

While the present invention has been described in detail with reference to the preferred embodiments, it should be understood that the above description should not be taken as limiting the invention. Various modifications and alterations to this invention will become apparent to those skilled in the art upon reading the foregoing description. Accordingly, the scope of the invention should be determined from the following claims.

Claims

A square photo shooting control method with redisplay is used for a mobile phone with a rectangular photo preview function, and is characterized by comprising the following steps:

s1, when the mobile phone operating system receives a photographing instruction of a user, acquiring a rectangular preview of the current scene through a camera of the mobile phone and displaying the rectangular preview on a screen;

s2, shielding the rectangular preview image displayed on the screen, and enabling the visible area on the screen to be square;

s3, moving the square area by the user to select and confirm the shot image;

and S4, the display content of the screen is not changed, and the background clips the image shot in S3 according to the area selected in S2 and displays the image back to the screen.
A square photograph taking control method with a redisplay according to claim 1, further comprising, after said step S4:

s5, compressing the image obtained in the S4 to generate a jpeg/jpg image;

and S6, feeding the jpeg/jpg image data back to the mobile phone operating system, and storing the image data by the mobile phone operating system.
A square photograph taking control method with a redisplay according to claim 1, further comprising, before said step S1:

and S0, confirming that the current photographing mode of the mobile phone is a square framing.
The square photograph shooting control method with the redisplay of claim 1, wherein in the step S3, the shooting mode is confirmed as a conventional key confirmation or a screen soft key touch confirmation or a voice control.
A square photograph taking control method with a redisplay according to claim 1, further comprising, after said step S4:

and S7, if the third-party software needs to call the photo data, sending the processing result of S4 to the third party.
A square photograph taking control method with a redisplay according to claim 2, further comprising, after said step S6:

s8, providing information of the current position, the current time and the current weather by third-party software, and recording the information in the attribute information of the jpeg/jpg image;

and S9, displaying the attribute information of the image in the jpeg/jpg image.
A photographing control apparatus for controlling a photographing process thereof using the method according to any one of claims 1 to 6, comprising:

an image sensor for capturing an image to form a rectangular preview image as described in step S1;

the viewfinder is connected with the image sensor and selects a square view from the image sensor;

the shutter is connected with the viewfinder and confirms that the picture is taken;

the central processing unit cuts and stores the shot picture according to the area selected by the viewfinder;

the saved picture is displayed on the screen.
The photographing control apparatus as claimed in claim 7, further comprising:

caching postview buffer in real time, wherein the postview buffer is used for caching the rectangular preview image obtained in the step S1;

a main buffer for storing the photo taken in step S3;

and the data buffer is used for storing the final square photo, and the square photo is obtained by cutting the photo in the main buffer according to the area selected by the viewfinder.
The picture-taking control device as claimed in claim 7, wherein the viewfinder is a software viewfinder, the rectangular preview picture is occluded with black color blocks, a view of a square is provided in visual effect, and a picture is not actually cut.
A mobile phone characterized by comprising the photographing control apparatus according to any one of claims 7 to 9.