CN111294510A

CN111294510A - Monitoring method and electronic equipment

Info

Publication number: CN111294510A
Application number: CN202010075816.6A
Authority: CN
Inventors: 潘慧宇
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2020-01-22
Filing date: 2020-01-22
Publication date: 2020-06-16

Abstract

The embodiment of the invention provides a monitoring method and electronic equipment, and relates to the technical field of electronics. By configuring a movable camera in the electronic device, when the camera of the electronic device cannot acquire the target content, the camera can be controlled to move along a frame, a top surface or a bottom surface in the electronic device, so that the camera can acquire the second image containing the target content. By the embodiment of the invention, the position of the camera in the electronic equipment can be automatically adjusted to enlarge the shooting range of the electronic equipment, and the problem that the monitoring range of the electronic equipment is limited can be solved.

Description

Monitoring method and electronic equipment

Technical Field

The present invention relates to the field of electronic technologies, and in particular, to a monitoring method and an electronic device.

Background

Along with the development of electronic technology, wearable intelligent electronic equipment such as intelligent watches, intelligent bracelets and the like appear. By wearing the intelligent electronic devices, the health state of the user can be monitored, for example, the sleep state, the sedentary state and the like of the user can be monitored.

However, due to the limitations of simple functions, limited computing capability and the like, the wearable intelligent electronic device has an inaccurate monitoring result, and may have misjudgment.

The smart phone is not only convenient to carry, but also has higher computing power, and can gradually replace wearable smart devices to realize functions of monitoring the health state of a user and the like. However, the shooting range and the placement state of the smartphone have a great influence, and for example, when the smartphone is placed horizontally, it is difficult to monitor the sleep state, the sedentary state, and the like of the user.

Disclosure of Invention

The embodiment of the invention provides a monitoring method and electronic equipment, and aims to solve the problem that the monitoring range of the electronic equipment is limited.

In order to solve the technical problem, the invention is realized as follows:

in a first aspect, an embodiment of the present invention further provides a detection method applied to an electronic device, where the electronic device is provided with a movable camera, and the method may include:

acquiring a first image through a camera;

and under the condition that the first image does not contain the target content, controlling the camera to move along a frame, a top surface or a bottom surface in the electronic equipment so as to enable a second image acquired by the camera to contain the target content.

In a second aspect, an embodiment of the present invention further provides an electronic device, where the electronic device is provided with a movable camera, and the electronic device includes:

the shooting module is used for acquiring a first image through a camera;

the control module is used for controlling the camera to move along a frame, a top surface or a bottom surface in the electronic equipment under the condition that the first image does not contain the target content, so that the second image acquired by the camera contains the target content.

A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the steps of the detection method according to any one of claims 1 to 8.

According to the embodiment of the invention, the movable camera is arranged in the electronic equipment, and under the condition that the camera of the electronic equipment cannot acquire the target content, the camera can be controlled to move along the frame, the top surface or the bottom surface in the electronic equipment, so that the camera can acquire the second image containing the target content. According to the embodiment of the invention, under the condition that the shooting range of the electronic equipment is limited, the position of the camera in the electronic equipment can be automatically adjusted, so that the shooting range of the electronic equipment is expanded, and the problem that the monitoring range of the electronic equipment is limited can be solved. In addition, the adjustment process does not need the user to hold the electronic equipment for adjustment, so that the operation cost of the user can be reduced, and convenience is brought to the user.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings needed to be used in the description of the embodiments of the present invention will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without inventive labor.

FIG. 1 is a flow chart illustrating the steps of a monitoring method according to an embodiment of the present invention;

fig. 2 is a schematic front view of a camera under a screen of an electronic device according to an embodiment of the present invention;

fig. 3 is a schematic diagram illustrating a preset track in an electronic device according to an embodiment of the present invention;

fig. 4 is a schematic view of an off-screen camera of a side panel of an electronic device according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of a preset track in another electronic device according to an embodiment of the invention;

fig. 6 is a block diagram of an electronic device according to an embodiment of the present invention;

fig. 7 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

In various embodiments of the present invention, it should be understood that the sequence numbers of the following processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.

Referring to fig. 1, an embodiment of the present invention provides a monitoring method applied to an electronic device, where the electronic device is provided with a movable camera, and the method includes:

step 101, acquiring a first image through a camera;

step 102, when the first image does not contain the target content, controlling the camera to move along a frame, a top surface or a bottom surface in the electronic equipment, so that a second image acquired by the camera contains the target content.

The monitoring method of the embodiment of the invention can be used for electronic equipment, and the electronic equipment specifically comprises but is not limited to: smart phones, tablet computers, electronic book readers, MP3 (Moving picture Experts Group Audio Layer III) players, MP4 (Moving picture Experts Group Audio Layer IV) players, laptop portable computers, car-mounted computers, desktop computers, set-top boxes, smart televisions, wearable devices, and the like.

In an embodiment of the present invention, the electronic device may include at least one camera, and the camera may move inside the electronic device, such as along a frame, a top surface, or a bottom surface inside the electronic device. It can be understood that the embodiment of the present invention does not limit the position of the movable camera disposed in the electronic device. For example, the movable camera may be disposed under a display screen, on a display screen, etc. of the electronic device.

Firstly, a first image is obtained through a camera, and the first image is acquired according to the current placing state of the electronic equipment and the current position of the camera in the electronic equipment. The current position of the camera in the electronic device may be a preset initial position or a position after the camera is moved last time.

Then, it is determined whether the first image contains target content, which may be an image of a target object to be monitored.

Finally, in the case that the target content is not included in the first image, the camera may be controlled to move inside the electronic device, so that the target content is included in the second image acquired by the camera, for example, the camera is controlled to move along a frame, a top surface, or a bottom surface inside the electronic device. The top surface and the bottom surface are relative concepts, and according to the placement condition of the electronic equipment, the covered surface is the bottom surface, and the uncovered surface is the top surface; according to the usage of the electronic device, the surface where the display screen is located may be a top surface, and the opposite surface is a bottom surface, and the like.

Alternatively, for an electronic device having at least one screen, a movable camera may be disposed under the display screen. Because when the electronic equipment is used and stands, the screen is outward usually, therefore, the movable camera is arranged under the display screen, the moving range of the camera is ensured, and simultaneously, the camera can shoot image data of environments in different directions. Fig. 2 is a schematic front view of a camera under a screen of an electronic device in an embodiment of the present invention, and as shown in fig. 2, a camera 201 is disposed under a display screen on the front of the electronic device, and the camera 201 can move.

In the embodiment of the present invention, the position of the mobile camera in the electronic device may include a planar position of the mobile camera in the electronic device, and/or a shooting angle of the mobile camera is changed. Alternatively, when image data in different directions are collected, picture data in different directions can be taken, or video data can be continuously recorded during moving. In the embodiment of the invention, the moving mode of the camera and the method for acquiring the image data are not limited.

In the embodiment of the present invention, the second image includes the target content, that is, the second image may be image data for monitoring the target object, and therefore, a position where the second image is captured may be regarded as a target position to be determined in a moving process of the camera. Further, the target position may be a position where the camera can shoot a monitoring image with a definition, a brightness, a target object integrity, and the like meeting preset conditions in order to monitor a target object in the environment.

Optionally, in the embodiment of the present invention, in the process of controlling the camera to move along the frame, the top surface, or the bottom surface inside the electronic device, image data in different directions may be collected, so that the second image acquired by the camera includes the target content. For example, in the process of acquiring image data in different directions, the acquired image data may be analyzed in real time, whether the acquired image data includes target content is judged, and parameters such as definition, brightness, target object integrity and the like are detected and compared to determine a target position.

In the embodiment of the invention, after the target position is determined, the camera can be moved to the target position, and the second image in the corresponding direction is collected at the target position. For example, the second image with the preset conditions of definition, brightness, target object integrity and the like is acquired from the target position, so that the condition of the target object is monitored according to the content reflecting the condition of the target object in the monitored image, and the inconvenience that a user manually adjusts the direction, the angle and the like of the camera of the electronic equipment for acquiring the monitored image of the target object is avoided while a better monitoring effect is achieved.

Optionally, the step 102 includes:

and controlling the camera to move along a preset track inside the electronic equipment, acquiring a third image in a direction corresponding to the current position by the camera when the camera moves for a preset distance, and traversing the preset track through a frame, a top surface or a bottom surface inside the electronic equipment. .

In the embodiment of the invention, the camera can move along a preset track of the electronic equipment, wherein the preset track passes through a frame, a top surface or a bottom surface inside the electronic equipment. In addition, the shape of the preset track may be set according to specific process conditions and monitoring requirements, and optionally, the preset track may be an open straight line, a curve, or the like, may also be a closed square, a closed ring, a closed triangle, or the like, or may also be a combination of various shapes, and the embodiment of the present invention is not limited to this specifically.

In this embodiment of the present invention, the third image may be image data of a direction corresponding to the current moving position acquired in a process of controlling the camera to move along the frame, the top surface, or the bottom surface inside the electronic device. Optionally, a plurality of preset rails may be arranged in the electronic device, the preset rails are respectively located on a frame, a top surface or a bottom surface of the electronic device, and a third image with a larger shooting range may be acquired by moving the camera on different preset rails. Fig. 3 is a schematic diagram of a preset track in an electronic device according to an embodiment of the present invention, as shown in fig. 3, a square preset track 302 is disposed below a front display screen of the electronic device, and as shown in a moving direction indicated by a dotted line, a camera 301 may move counterclockwise along the preset track 302 to acquire image data, or may move clockwise.

In the embodiment of the invention, the process of acquiring the third image through the camera can be that the camera is controlled to acquire the third image in the direction corresponding to the current position once every time the camera moves the preset distance, so that when the image data of the current position is recorded, the current position can be accurately determined according to the preset distance, the acquisition times of the third image, the moving direction and the like. The preset distance can be determined according to hardware parameters of the camera and the storage and calculation capabilities of the electronic equipment, and when the performance of the camera is good and the storage and calculation capabilities of the electronic equipment are strong, the preset distance can be set to be short, otherwise, the preset distance can be set to be long, so that the frequency of acquiring image data is adjusted; or, the preset distance can be set to be longer, the approximate range of the target position is determined, then the preset distance is gradually reduced to finally determine the target position, and the accuracy of determining the target position is improved while the storage and calculation resources of the electronic equipment are saved.

In the embodiment of the present invention, when the camera moves on the preset track, optionally, the camera may stop after determining the target position in real time, or after each position on the preset track passes at least once during the process that the camera moves on the preset track, that is, the camera stops after traversing the preset track. In addition, optionally, when all the image data acquired in the traversal does not reach the preset condition, the traversal may be repeated until the target position is determined, or after the traversal is repeated for a certain number of times, the user is prompted to automatically determine the target position to fail, and the user is requested to manually adjust the target position.

Optionally, the display screen of the electronic device may include a front screen and a side screen, and the preset track may include a first preset track located under the front screen and a second preset track located under the side screen; when the camera is located in the first preset track, the shooting direction is opposite to the front screen; when the camera is located in the second preset track, the shooting direction is opposite to the side screen.

In the embodiment of the present invention, the display screen of the electronic device may be a curved screen, and at this time, the curved screen includes a front screen and a side screen, and therefore, the corresponding preset track may include a first preset track under the front screen and a second preset track under the side screen. The side screen can comprise side screens distributed on any side edge of the curved screen, the second track comprises a preset track below the side screen of each side face, and the second track can traverse all the side screens. Optionally, the first preset track and the second preset track may be in different directions on the same track, wherein the shooting direction of the camera of the first preset track is opposite to the front screen, and the shooting direction of the camera of the second preset track is opposite to the side screen; at this time, the camera of the first preset track and the camera of the first preset track may be different cameras or the same camera, and different shooting directions are achieved by turning. Alternatively, the first preset track and the second preset track may be different tracks, which is not limited in this embodiment of the present invention. Fig. 4 is a schematic view of an off-screen camera of a side screen of an electronic device in an embodiment of the present invention, and as shown in fig. 4, the side screen is a side screen of any side of the electronic device, a camera 401 is disposed below the side screen, and the camera 401 is movable.

Fig. 5 is a schematic diagram of a preset track in another electronic device according to an embodiment of the present invention, in fig. 5, a left diagram is a schematic diagram of a front panel, and a right diagram is a schematic diagram of a side panel. As shown in fig. 5, a first preset rail 5011 is disposed under the front panel 501 of the electronic device, a second preset rail 5031 is disposed under the side panel 502, and the side panel 502 may include any side panel of the electronic device. The shooting direction of the camera 502 is opposite to the front panel 501 and moves on the first preset track 5011, the shooting direction of the camera 502 is opposite to the side panel 503 and moves on the second preset track 5031, and the shooting direction of the camera 502 can be changed by rotating.

Optionally, the camera includes a first camera and a second camera; before the step 101, the method further includes:

step S11, detecting the ambient light intensity around the electronic equipment;

the step 102 comprises:

step S12, controlling the first camera to move along a frame, a top surface or a bottom surface in the electronic equipment under the condition that the ambient light intensity is greater than or equal to a preset light intensity;

and step S13, controlling the second camera to move along the frame, the top surface or the bottom surface in the electronic equipment under the condition that the ambient light intensity is smaller than the preset light intensity.

In the embodiment of the invention, because the environment where the monitored target object is located may be different from the normal shooting environment, such as night, haze, low temperature, and the like, at this time, a camera specially used for the environmental condition may need to be additionally equipped to acquire image data, so as to ensure that the monitoring of the target object is normally performed. Optionally, taking the ambient light intensity as an example, before the position of the camera is moved to collect image data, the ambient light intensity may be detected by the optical sensor, so as to determine which camera needs to be used to collect the image data.

In the embodiment of the present invention, optionally, the detected ambient light intensity may be compared with a preset light intensity, and when the ambient light intensity is greater than or equal to the preset light intensity, it is determined that the current electronic device is in a bright environment, and if the target object is a long-time working and sitting of the electronic device user in the daytime, a first camera may be used to collect image data, where the first camera is a camera that can normally shoot a picture or a video when the ambient light intensity is greater than or equal to the preset light intensity; when ambient light intensity is less than preset light intensity, then think that current electronic equipment is in among the environment of dark, if the target object is the electronic equipment user and is currently in evening rest and sleep, can adopt the second camera to carry out image data acquisition this moment, wherein, the second camera means when ambient light intensity is less than preset light intensity, can carry out the camera of normal shooting, like infrared camera, white light camera etc.. The corresponding camera is selected according to the environmental conditions, so that the monitoring process can cope with complex and changeable environments, and the monitoring system is more practical.

Optionally, the target content includes a human body, and the step 102 may include:

step S21, determining the human body image proportion in each third image;

step S22, determining target image data in the third image according to the human body image proportion;

and step S23, determining the target position of the camera in the electronic equipment according to the shooting position corresponding to the target image.

And step S24, moving the camera to the target position, and acquiring a second image in the direction corresponding to the target position through the camera.

In the embodiment of the present invention, when the target object is a person, the target image data may be determined by calculating the human image proportion in the third image. Because more than one person may enter the lens in the shooting direction of the camera, at the moment, the target object can be determined through face recognition, and then the human body image proportion of the target object is calculated. The human body image proportion can be the ratio of the area of the human body face, the trunk, the limbs and the like in the third image to the total area of the third image.

In the embodiment of the present invention, the target image data may be determined according to the size of the human body image proportion, for example, when the human body image proportion reaches the proportion threshold, the corresponding third image is determined as the target image data, or the third image with the largest human body image proportion is determined as the target image data. In addition, when the maximum human body image proportion does not reach the proportion threshold value, the camera is moved again to collect third images in different directions, optionally, the mode of collecting the third images can be properly adjusted in the process of collecting the third images by the moving camera, and repeated useless image data collection is avoided.

In the embodiment of the invention, the process of calculating and comparing the human body image ratio can be carried out after the third image is acquired, and can also be carried out simultaneously with the process of acquiring the third image. If the third image is acquired, the image data with the human body image ratio reaching a ratio threshold or the maximum can be used as target image data, and the shooting position of the target image data is used as a target position; if the third image is acquired simultaneously, the third image corresponding to the human body image ratio peak value can be used as target image data after the human body image ratio has a trend of ascending first and then descending, the shooting position of the target data is used as a target position, at the moment, the current position of the camera is closer to the target position, and the adjusting efficiency is higher.

Optionally, the step 102 includes:

and under the condition that the time length of the electronic equipment in the standing state is detected to exceed the preset time length, controlling the camera to move along the frame, the top surface or the bottom surface in the electronic equipment.

In the embodiment of the present invention, a condition that the electronic device starts monitoring the target object may be set, and optionally, the condition may be set by receiving an input for triggering start of monitoring, such as clicking a "start monitoring" button, or receiving a voice input sent by a user for controlling start of monitoring, such as "start sedentary monitoring" or the like; or determining to start monitoring according to the real-time state of the electronic device, for example, when the time length of the electronic device in the standing state exceeds the preset time length, that is, the electronic device is placed on a desktop, a support, or the like to reach the preset time length, the monitoring is started. In addition, during the standing state, the electronic device may be in a working state at the same time, such as playing music, video, broadcast, etc., and the monitoring of the target object is not affected.

Optionally, after the step 102, the method may further include:

step S31, performing face recognition on at least one human body image in the second image to determine a target user;

step S32, performing human body detection on the human body image of the target user in the second image, and determining the behavior action of the target user;

step S33, counting the frequency of the behavior action in the second image;

and step S34, determining the monitoring result of the target user according to the frequency of the behavior action.

In the embodiment of the invention, after the second image is acquired through the target position of the camera, the second image can be analyzed, so that the condition of the target object is determined. Alternatively, the target user in the second image may be determined by face recognition first. And then, carrying out human body detection on the human body image of the target user to determine the behavior action of the target user, wherein the behavior action comprises the type, frequency, amplitude and the like of the behavior action, and the face recognition and the human body detection can be realized through a deep learning algorithm. According to the frequency of behavior actions of different types, amplitudes and the like, the monitoring result of the target user can be further determined.

Optionally, after the step 103, the method may further include:

and under the condition that an interruption event is detected, stopping collecting a second image in the direction corresponding to the target position through the camera, and/or moving the camera to a preset initial position.

In the embodiment of the invention, when the interrupt event is detected, the monitoring of the target object can be stopped, and at the moment, the camera can stop collecting the second image in the direction corresponding to the target position. The interruption event may include detection of the electronic device being moved in a motion state by an acceleration sensor, a level sensor, or the like in the electronic device, or alarm ring preset by the electronic device, or the like. Optionally, after an interrupt event occurs, since it cannot be determined whether the electronic device needs to continue monitoring, the camera may be directly reset to return to the preset initial position before moving; or, whether to continue monitoring can be determined according to the input of the user, if so, the camera is moved to re-determine the target position, and if not, the camera is reset.

In practical applications, for example, when the electronic device has a curved screen and the screen is placed upward and the target user has a predetermined length of time on the pillow, the infrared camera of the electronic device turns to the second predetermined track, so as to face the target user. After moving on the second preset track to obtain image data, determining the image data with the largest human body image ratio in all the image data as target image data, and monitoring the sleep state of the target user by taking the shooting position of the target image data as a target position.

After a second image of the target user is obtained, the second image is identified according to a deep learning human sleep action identification algorithm so as to identify the sleep action types of the target user, such as turning over, calling, kicking quilt, talking dream and the like; frequency, turning over 1 time per hour, talking once per half hour, etc.; and magnitude, such as full turn, half turn, etc. And determining the sleep quality of the target user according to the recognition result of the sleep behavior action. When the situation that the turnover frequency of the target user is too high and the interruption time does not occur yet is monitored, the target user is determined to have poor sleep quality, and the target user can be helped to adjust the sleep state by playing white noise or soothing music.

Or, in practical application, taking the detection of the sedentary state of the user as an example, when the screen of the electronic device is placed on a workbench of a target user upwards, the camera of the electronic device acquires image data in different directions by turning and moving on a preset track, and simultaneously calculates the human body image proportion of the image data, when the human body image proportion is increased first and then decreased, determines the image data corresponding to the human body image proportion of the peak value as the target image data, and monitors the sedentary state of the target user by taking the shooting position of the target image data as the target position.

After a second image of the target user is obtained, the second image is identified according to a deep learning human body sedentary action identification algorithm so as to identify the sedentary action types of the target user, such as getting up, lifting legs, drinking water, typing, reading and turning pages and the like; and frequency, once every half hour, once every twenty minutes drinking water, etc.; and amplitude, such as half-rise, full-rise, etc. When the target user is monitored not to get up for a certain time, the target user can be determined to have poor sedentary quality, for example, the target user can be reminded to "you have not got up for 60 minutes, need to act", and the like.

With the foregoing description of the monitoring method according to the embodiment of the present invention, an electronic device according to the embodiment of the present invention will be described with reference to the accompanying drawings.

Referring to fig. 6, an embodiment of the present invention further provides an electronic device 600, including:

a shooting module 601, configured to obtain a first image through a camera;

the control module 602 is configured to, when the first image does not include the target content, control the camera to move along a frame, a top surface, or a bottom surface inside the electronic device, so that a second image acquired by the camera includes the target content.

Optionally, the control module 602 is specifically configured to control the camera to move along a preset track inside the electronic device, and when the camera moves a preset distance, the camera collects a third image in a direction corresponding to the current position until the camera traverses the preset track, where the preset track passes through a frame, a top surface, or a bottom surface inside the electronic device.

Optionally, the display screen includes a front screen and a side screen, and the preset rail includes a first preset rail located under the front screen and a second preset rail located under the side screen; when the camera is located in the first preset track, the shooting direction is opposite to the front screen; when the camera is located in the second preset track, the shooting direction is opposite to the side screen.

Optionally, the camera includes a first camera and a second camera; the electronic device 500 further comprises:

the illumination detection module is used for detecting the ambient illumination intensity around the electronic equipment;

the image acquisition module 601 includes:

the first control submodule is used for controlling the first camera to move along a frame, a top surface or a bottom surface in the electronic equipment under the condition that the ambient illumination intensity is greater than or equal to a preset light intensity;

and the second control submodule is used for controlling the second camera to move along the frame, the top surface or the bottom surface in the electronic equipment under the condition that the ambient illumination intensity is smaller than the preset light intensity.

Optionally, the target content includes a human body, and the electronic device further includes:

the human body detection module is used for determining the human body image ratio in each third image;

the image determining module is used for determining a target image in the third image according to the human body image proportion;

the position determining module is used for determining the target position of the camera in the electronic equipment according to the shooting position corresponding to the target image;

and the mobile monitoring module is used for moving the camera to the target position and acquiring a second image in the direction corresponding to the target position through the camera.

Optionally, the control module 602 is specifically configured to control the camera to move along a frame, a top surface, or a bottom surface in the electronic device when it is detected that a duration of the electronic device in the standing state exceeds a preset duration.

Optionally, the electronic device 600 further includes:

the face recognition module is used for carrying out face recognition on at least one human body image in the second image to determine a target user;

the action recognition module is used for carrying out human body detection on the human body image of the target user in the second image and determining the behavior action of the target user;

the frequency counting module is used for counting the frequency of the behavior action in the second image;

and the result determining module is used for determining the monitoring result of the target user according to the frequency of the behavior action.

Optionally, the electronic device 600 further includes:

and the monitoring interruption module is used for stopping collecting a second image in the direction corresponding to the target position through the camera and/or moving the camera to a preset initial position under the condition that an interruption event is detected.

The electronic device 600 provided in the embodiment of the present invention can implement each process implemented by the electronic device in the method embodiments of fig. 1 to fig. 5, and is not described here again to avoid repetition.

In the embodiment of the invention, the camera in the electronic equipment is moved, and the target environment image which meets the preset index is determined according to the environment image which is acquired by the camera in real time in the moving process, so that the shooting position corresponding to the target environment image is determined to be the target position of the camera, and the detection image in the corresponding direction is shot at the target position. Therefore, the shooting position of the monitoring image suitable for the current electronic equipment can be automatically determined without the need of adjusting the shooting direction by a user, the operation cost of the user can be reduced, and convenience is brought to the user. In addition, the electronic equipment is used for monitoring the state of the user, so that not only can high-quality monitoring images be obtained, but also the electronic equipment has higher computing capability compared with wearable equipment, and the accuracy of monitoring and analyzing results can be improved.

FIG. 7 is a diagram illustrating a hardware configuration of an electronic device implementing various embodiments of the invention;

the electronic device 700 includes, but is not limited to: a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, a processor 710, a power supply 711, a camera module 712, and the like. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 7 does not constitute a limitation of the electronic device, and that the electronic device may include more or fewer components than shown, or some components may be combined, or a different arrangement of components. In the embodiment of the present invention, the electronic device includes, but is not limited to, a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted terminal, a wearable device, a pedometer, and the like.

A processor 710 for obtaining a first image through a camera module 712; and under the condition that the first image does not contain the target content, controlling the camera module 712 to move along a frame, a top surface or a bottom surface in the electronic device, so that the second image acquired by the camera module 712 contains the target content.

In the embodiment of the invention, the camera in the electronic equipment is moved, and the target environment image which meets the preset index is determined according to the environment image which is acquired by the camera in real time in the moving process, so that the shooting position corresponding to the target environment image is determined to be the target position of the camera, and the detection image in the corresponding direction is shot at the target position. Therefore, the shooting position of the monitoring image suitable for the current electronic equipment is automatically determined without the need of multiple adjustment of a user, the high-quality monitoring image is obtained, and the accuracy of the monitoring analysis result is improved.

It should be understood that, in the embodiment of the present invention, the radio frequency unit 701 may be used for receiving and sending signals during a message transmission and reception process or a call process, and specifically, receives downlink data from a base station and then processes the received downlink data to the processor 710; in addition, the uplink data is transmitted to the base station. In general, radio frequency unit 701 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 701 may also communicate with a network and other devices through a wireless communication system.

The electronic device provides wireless broadband internet access to the user via the network module 702, such as assisting the user in sending and receiving e-mails, browsing web pages, and accessing streaming media.

The audio output unit 703 may convert audio data received by the radio frequency unit 701 or the network module 702 or stored in the memory 709 into an audio signal and output as sound. Also, the audio output unit 703 may also provide audio output related to a specific function performed by the electronic apparatus 700 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 703 includes a speaker, a buzzer, a receiver, and the like.

The input unit 704 is used to receive audio or video signals. The input Unit 704 may include a Graphics Processing Unit (GPU) 7041 and a microphone 7042, and the Graphics processor 7041 processes image data of a still picture or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 706. The image frames processed by the graphic processor 7041 may be stored in the memory 709 (or other storage medium) or transmitted via the radio unit 701 or the network module 702. The microphone 7042 may receive sounds and may be capable of processing such sounds into audio data. The processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 701 in case of a phone call mode.

The electronic device 700 also includes at least one sensor 705, such as a light sensor, motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 7071 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 7071 and/or a backlight when the electronic device 700 is moved to the ear. As one type of motion sensor, an accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), detect the magnitude and direction of gravity when stationary, and can be used to identify the posture of an electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), and vibration identification related functions (such as pedometer, tapping); the sensors 705 may also include fingerprint sensors, pressure sensors, iris sensors, molecular sensors, gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., which are not described in detail herein.

The display unit 706 is used to display information input by the user or information provided to the user. The Display unit 706 may include a Display panel 7071, and the Display panel 7071 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 707 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 707 includes a touch panel 7071 and other input devices 7072. The touch panel 7071, also referred to as a touch screen, may collect touch operations by a user on or near the touch panel 7071 (e.g., operations by a user on or near the touch panel 7071 using a finger, a stylus, or any other suitable object or attachment). The touch panel 7071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 710, receives a command from the processor 710, and executes the command. In addition, the touch panel 7071 can be implemented by various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 707 may include other input devices 7072 in addition to the touch panel 7071. In particular, the other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described herein again.

Further, the touch panel 7071 may be overlaid on the display panel 7071, and when the touch panel 7071 detects a touch operation thereon or nearby, the touch operation is transmitted to the processor 710 to determine the type of the touch event, and then the processor 710 provides a corresponding visual output on the display panel 7071 according to the type of the touch event. Although the touch panel 7071 and the display panel 7071 are shown in fig. 7 as two separate components to implement the input and output functions of the electronic device, in some embodiments, the touch panel 7071 and the display panel 7071 may be integrated to implement the input and output functions of the electronic device, which is not limited herein.

The interface unit 708 is an interface for connecting an external device to the electronic apparatus 700. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 708 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 700 or may be used to transmit data between the electronic apparatus 700 and the external device.

The memory 709 may be used to store software programs as well as various data. The memory 709 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 709 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 710 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, performs various functions of the electronic device and processes data by running or executing software programs and/or modules stored in the memory 709 and calling data stored in the memory 709, thereby monitoring the whole electronic device. Processor 710 may include one or more processing units; preferably, the processor 710 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 710.

The electronic device 700 may also include a power supply 711 (e.g., a battery) for providing power to the various components, and preferably, the power supply 711 may be logically coupled to the processor 710 via a power management system, such that functions of managing charging, discharging, and power consumption may be performed via the power management system.

In addition, the electronic device 700 includes some functional modules that are not shown, and are not described in detail herein.

Preferably, an embodiment of the present invention further provides an electronic device, which includes a processor 710, a memory 709, and a computer program stored in the memory 709 and capable of running on the processor 710, where the computer program, when executed by the processor 710, implements each process of the control method embodiment of the application program, and can achieve the same technical effect, and details are not repeated here to avoid repetition.

The embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the computer program implements each process of the control method embodiment of the application program, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here. The computer-readable storage medium may be a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. A monitoring method is applied to electronic equipment, and is characterized in that the electronic equipment is provided with a movable camera, and the method comprises the following steps:

acquiring a first image through a camera;

2. The method of claim 1, wherein the controlling the camera to move along a bezel, a top surface, or a bottom surface inside the electronic device comprises:

and controlling the camera to move along a preset track inside the electronic equipment, acquiring a third image in a direction corresponding to the current position by the camera when the camera moves for a preset distance, and traversing the preset track through a frame, a top surface or a bottom surface inside the electronic equipment.

3. The method of claim 2, wherein the target content comprises a human body, and after the camera traverses the preset trajectory, the method further comprises:

determining the ratio of the human body images in each third image;

determining a target image in the third image according to the human body image proportion;

determining the target position of the camera in the electronic equipment according to the shooting position corresponding to the target image;

and moving the camera to the target position, and acquiring a second image in the direction corresponding to the target position through the camera.

4. The method of claim 1, wherein the camera comprises a first camera and a second camera; before the controlling the camera to move along the frame, the top surface or the bottom surface in the electronic device, the method further comprises:

detecting the ambient light intensity around the electronic equipment;

the control the camera is in the inside of electronic equipment moves along frame, top surface or bottom surface, includes:

under the condition that the ambient illumination intensity is greater than or equal to the preset light intensity, controlling the first camera to move along a frame, a top surface or a bottom surface in the electronic equipment;

and under the condition that the ambient illumination intensity is smaller than the preset light intensity, controlling the second camera to move along the frame, the top surface or the bottom surface in the electronic equipment.

5. The method of claim 1, wherein the controlling the camera to move along a bezel, a top surface, or a bottom surface inside the electronic device comprises:

6. An electronic apparatus, characterized in that the electronic apparatus is provided with a movable camera, the electronic apparatus comprising:

the shooting module is used for acquiring a first image through a camera;

7. The electronic device according to claim 6, wherein the control module is specifically configured to control the camera to move along a preset track inside the electronic device, and when the camera moves a preset distance, the camera acquires a third image in a direction corresponding to a current position until the camera traverses the preset track, where the preset track passes through a frame, a top surface, or a bottom surface inside the electronic device.

8. The electronic device of claim 6, wherein the target content comprises a human body, the electronic device further comprising:

the human body detection module is used for carrying out human body detection on the acquired third images and determining the human body image proportion corresponding to the target content in each second image;

9. The electronic device of claim 6, wherein the camera comprises a first camera and a second camera; before the controlling the camera to move along the frame, the top surface or the bottom surface inside the electronic device, the electronic device further includes:

the control module includes:

10. An electronic device, comprising a processor, a memory and a computer program stored on the memory and executable on the processor, the computer program, when executed by the processor, implementing the steps of the detection method according to any one of claims 1 to 5.