CN115604513A - A system mode switching method, electronic device, and computer-readable storage medium - Google Patents

Abstract

The application relates to the field of electronic equipment, and discloses a system mode switching method, electronic equipment and a computer-readable storage medium. The method includes: running the first system mode; acquiring the voice of the user of the electronic device, and parsing out the instruction from the voice; determining that the instruction includes a preset wake-up word for switching the first system mode; The collected user image, and according to the user image, determine that the user includes the user of the preset user type; according to the instruction, and according to the user image and the determined user of the preset user type, switch the electronic device from the first system mode to the preset user Type corresponds to the second system mode. This is beneficial to improving the convenience and accuracy of switching the system mode of the electronic device.

Description

A system mode switching method, electronic device, and computer-readable storage medium

technical field

The present application relates to the field of electronic equipment, and in particular to a system mode switching method, electronic equipment, and a computer-readable storage medium.

Background technique

With the popularity of smart home devices, smart TVs have entered thousands of households. The system modes of a smart TV generally include a normal mode and a children's mode.

When the children in the family use the smart TV, the system mode of the smart TV can be switched from the normal mode to the children's mode, that is, the smart TV exits the normal mode (starting the children's mode), so that the children at home can control the scope, duration, sitting posture, etc. . When an adult at home uses the smart TV, the system mode of the smart TV can be switched from the child mode to the normal mode, that is, the smart TV exits the child mode (starts the normal mode).

There are many problems when the above-mentioned smart TV exits the children's mode, such as children are easy to imitate adults to complete the exit, the elderly are difficult to operate, and the voiceprint recognition error rate is high.

Contents of the invention

The embodiment of the present application provides a system mode switching method, which is used to improve the operation convenience and accuracy of switching the system mode of an electronic device.

In order to achieve the above object, the embodiments of the present application adopt the following technical solutions:

In the first aspect, the embodiment of the present application discloses a system mode switching method, which is applied to an electronic device (such as a smart TV). The method includes: running the first system mode; acquiring the voice of the user of the electronic device, and analyzing the Instruction; determine that the instruction includes a preset wake-up word for switching the first system mode; acquire a user image collected for a user in front of the electronic device, and determine according to the user image that the user includes a user of a preset user type; according to the instruction, and According to the user image and the determined user of the preset user type, the electronic device is switched from the first system mode to the second system mode corresponding to the preset user type.

The above-mentioned first system mode is described by taking the child mode as an example, and the second system mode is described by taking the normal mode as an example. According to the embodiment of the present application, the command to exit the children's mode is triggered by recognizing the user's voice, and the presence of an adult is determined by recognizing the user's image. Therefore, according to the instruction to exit the children's mode and the presence of an adult, the smart TV can be completed. Exit action for child mode. Therefore, the child mode exit operation path is short, and the usability is high. Moreover, user identification is accurate, and it is not easy to be bypassed by children.

In some possible implementation manners, the above-mentioned system mode switching method is suitable for exiting the guest mode of the mobile phone.

In a possible implementation of the above first aspect, the user image includes a first user image and a second user image;

Switching the electronic device from the first system mode to the second system mode corresponding to the preset user type according to the user image and the determined user of the preset user type according to the instruction includes:

generating a confirmation window according to the instruction and the user of the preset user type determined from the first user image;

In response to the generation of the confirmation window, acquire a user image collected by the user in front of the electronic device as a second user image, and determine an action instruction according to the second user image;

Switching the electronic device from the first system mode to the second system mode corresponding to the preset user type according to the action instruction and the user of the preset user type determined from the second user image.

In a possible implementation of the first aspect above, the action instruction is based on a static action.

In a possible implementation of the foregoing first aspect, the action instruction is based on a dynamic action, and the dynamic action includes a user's body action.

In a possible implementation of the foregoing first aspect, the first user image includes a static image, and the users determined according to the static image include users of a preset user type.

In a possible implementation of the above first aspect, the user of the preset user type is the sender of the voice.

In a possible implementation of the first aspect above, the electronic device is switched from the first system mode to the second system mode corresponding to the preset user type according to the instruction and according to the user image and the determined user of the preset user type ,include:

Determine the action command according to the user image;

According to the instruction, and according to the determined user of the preset user type and the action instruction, the electronic device is switched from the first system mode to the second system mode corresponding to the preset user type.

In a possible implementation of the foregoing first aspect, the user image includes a static image, and the users determined according to the static image include users of a preset user type.

In a possible implementation of the foregoing first aspect, the user image includes a dynamic image, and the dynamic image includes body movements of the user.

In a possible implementation of the foregoing first aspect, the body movement includes a hand waving gesture.

In a possible implementation of the above first aspect, the preset user type is an adult, the first system mode is a child mode, and the second system mode is a normal mode.

In the second aspect, the embodiment of the present application provides an electronic device, including: a pickup, used to collect the voice of the user; a camera, used to collect the user image of the user; a processor; a memory, the memory includes instructions, and the instructions are processed by the processor During execution, the electronic device is made to execute the system mode switching method provided in any implementation manner of the first aspect above.

In the third aspect, the embodiments of the present application provide a computer-readable storage medium, on which instructions are stored, and when the instructions are executed on a computer, the computer executes the method provided by any implementation manner of the above-mentioned first aspect. System mode switching method.

Description of drawings

Fig. 1 shows a first schematic diagram of a smart home scene according to some embodiments of the present application;

Fig. 2 shows a schematic flow diagram of a smart TV exiting the children's mode according to some embodiments of the present application;

FIG. 3 is a schematic structural diagram of an electronic device provided in an embodiment of the present application;

FIG. 4 shows a flowchart of a system mode switching method provided by an embodiment of the present application;

Fig. 5 shows a second schematic diagram of a smart home scene according to some embodiments of the present application;

Fig. 6 shows a third schematic diagram of a smart home scene according to some embodiments of the present application;

Fig. 7 shows a fourth schematic diagram of a smart home scene according to some embodiments of the present application;

FIG. 8 shows a block diagram of an electronic device provided by an embodiment of the present application;

FIG. 9 shows a block diagram of a system on chip (SoC) provided by an embodiment of the present application.

detailed description

Specific embodiments of the present application will be described in detail below with reference to the accompanying drawings.

The present application provides a system mode switching method, which is used in electronic equipment such as televisions, and is beneficial to improving the convenience and accuracy of switching the system mode of the electronic equipment.

Fig. 1 shows an example of a smart home scenario including multiple electronic devices. In the scenario shown in FIG. 1 , specific electronic devices include: a smart TV 100 and a sound box 200 .

According to some embodiments of the present application, the smart TV 100 can interact with the cloud or other devices (for example, interact with the speaker 200 ) through the network. Moreover, the smart TV 100 can be equipped with an operating system, so that users can install and uninstall various application software by themselves while enjoying ordinary TV content, and continuously expand and upgrade functions. For example, the smart TV 100 may have interactive applications in various ways, such as human-computer interaction, multi-screen interaction, content sharing, and the like. It should be noted that the TV in each embodiment of the present application may be the smart TV 100 mentioned above, or a smart screen with a larger screen.

According to some embodiments of the present application, the speaker 200 may be a smart speaker. Exemplarily, the smart speaker 200 has a sound pickup function and can collect a user's voice.

According to some embodiments of the present application, the above-mentioned system modes of the smart TV 100 include a normal mode and a children's mode. According to the type (adult or child) of the user using the smart TV 100, the smart TV 100 activates a corresponding system mode. When a child uses the smart TV 100, the smart TV 100 is switched to the children's mode. As shown in FIG. 1 , the smart TV 100 is in the children's mode, and the children at home sit on the sofa and watch a video of children playing football.

When an adult uses the smart TV 100, the smart TV 100 exits the children's mode, that is, the system mode of the smart TV 100 is switched from the children's mode to the normal mode. Referring to FIG. 2 , according to a scheme for the smart TV 100 to exit the children's mode, the process is mainly divided into the following three parts:

(1) Wake up trigger

After the user (such as an adult) exits the current video playback of the Smart TV 100 through the remote control of the Smart TV 100, select the exit child mode icon on the Smart TV 100; Show a confirmation popup to exit Kid Mode.

(2) check

The user reads the confirmation message on the confirmation pop-up box for exiting child mode, and performs user identity authentication. Among them, there are currently three main forms of user identity authentication: ①user preset user identity password; ②simple mathematical calculation; ③verification of recorded voiceprint.

(3) response

If the user identity authentication meets the verification requirements, the smart TV 100 exits the child mode. Otherwise, the smart TV 100 does not perform the process of exiting the child mode.

It can be seen from the above that in the above scheme, the process of exiting the children’s mode of the smart TV 100 mainly has the following problems: (1) The operation path for exiting the children’s mode is relatively long; authentication form) is easily bypassed by children; (3) the success rate of voiceprint recognition is low (the third identity authentication form); (4) relies on remote control operation; (5) it is relatively difficult for the elderly to operate.

All in all, if the above problems exist in the process of exiting the child mode of the smart TV 100, it will lead to user experience problems such as inconvenient operation and low accuracy.

To this end, the present application provides a system mode switching method, which generates an instruction to trigger exiting the children's mode by recognizing the user's voice, and determines that an adult is present by recognizing the user's image, so that according to the instruction to exit the children's mode and the presence of an adult, The exit operation of the child mode of the smart TV can be completed. Therefore, the child mode exit operation path is short, and the usability is high. Moreover, user identification is accurate, and it is not easy to be bypassed by children.

In the scenario shown in FIG. 1 , a smart TV 100 is provided as an example of a body of an electronic device. But the present application is not limited thereto, and the electronic device may be various electronic devices with a camera 101 and a pickup. For example, various smart home devices (such as speaker 200 shown in FIG. 1 , smart alarm clock, etc.), mobile phones, tablet computers, desktop computers, laptop computers, vehicle-mounted terminals, artificial intelligence (artificial intelligence, AI) intelligent voice terminals , wearable devices, augmented reality (augmented reality, AR) equipment, virtual reality (virtual reality, VR) equipment, ultra-mobile personal computer (ultra-mobile personal computer, UMPC), handheld computer, netbook, personal digital assistant (personal digital assistant) assistant, PDA) and other electronic devices. Exemplary embodiments of electronic devices include, but are not limited to, various electronic devices equipped with IOS, Android, Microsoft, HarmonyOS, or other operating systems.

Fig. 3 shows a schematic structural diagram of an electronic device 001 according to an embodiment of the present application. The structure of the smart TV 100 in the above embodiments may be the same as that of the electronic device 001 . Specifically, the electronic device 001 may include:

Display 102: has a display interface. The display interface is used to play videos or display screen projections from computers or mobile phones, etc. For example, the display screen 102 displays an icon of the children's mode, and plays the video of children playing football described in the above embodiments. Exemplarily, the display screen 102 may be a capacitive touch screen.

Processor 110: may include one or more processing units, for example, may include a central processing unit CPU (Central Processing Unit), an image processor GPU (Graphics Processing Unit), a digital signal processor DSP, a microprocessor MCU (Micro- Programmed Control Unit), AI (Artificial Intelligence, artificial intelligence) processor or programmable logic device FPGA (Field Programmable Gate Array) and other processing modules or processing circuits. Wherein, different processing units may be independent devices, or may be integrated in one or more processors. The processor can switch the system mode according to the recognized voice and image of the user.

A memory 180 or a cache may be provided in the processor 110 for storing instructions and data. In an implementable manner, the memory 180 or the buffer may include a correspondence between user images and user types, or may include a correspondence between user voices, user types, and system modes. The above correspondence can be pre-stored in the memory 180. After the processor 110 recognizes the user's voice and user image, it searches the memory 180 whether there is a corresponding system mode. If so, the processor 110 switches the system mode.

The power module 140 may include a power supply, power management components, and the like. The power source can be a battery. The power management component is used to manage the charging of the power supply and the power supply from the power supply to other modules. In some embodiments, the power management component includes a charge management module and a power management module. The charging management module is used to receive charging input from the charger; the power management module is used to connect the power supply, the charging management module and the processor 110 . The power management module receives power and/or input from the charging management module, and supplies power to the processor 110 , the display screen 102 , the camera 170 , and the wireless communication module 120 .

The wireless communication module 120 may include an antenna, and transmit and receive electromagnetic waves via the antenna. The wireless communication module 120 can provide wireless local area network (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite system, etc. applied on the electronic device 001. (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The electronic device 001 can communicate with the network and other devices (eg mobile phone, speaker 200 ) through wireless communication technology.

The audio module 150 is used to convert digital audio information into analog audio signal output, or convert analog audio input into digital audio signal. The audio module 150 may also be used to encode and decode audio signals. In some embodiments, the audio module 150 may be set in the processor 110 , or some functional modules of the audio module 150 may be set in the processor 110 . In some embodiments, the audio module 150 may include a speaker, an earpiece, a pickup, and an earphone jack.

The camera 170 is used to capture still images or dynamic images. The object generates an optical image through the lens and projects it to the photosensitive element. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to an ISP (Image Signal Processing, image signal processing) to convert it into a digital image signal. The electronic device 001 can realize the shooting function through an ISP, a camera 170, a video codec, a GPU (Graphic Processing Unit, graphics processor), a display screen 102, and an application processor.

The interface module 160 includes an external memory interface, a universal serial bus (universal serial bus, USB) interface, and the like. The external memory interface can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 001 . The external memory card communicates with the processor 110 through the external memory interface to realize the data storage function. The universal serial bus interface is used for the electronic device 001 to communicate with other electronic devices.

In some embodiments, the electronic device 001 further includes a button 101 . Wherein, the key 101 may include a volume key, an on/off key, and the like.

In some embodiments, the electronic device 001 further includes a touch detection device 190 . Wherein, the touch detection device 190 can detect the position of the user's touch point, and recognize the corresponding touch gesture according to the position of the user's touch point.

It can be understood that, the structure shown in the embodiment of the present invention does not constitute a specific limitation on the electronic device 001 . In other embodiments of the present application, the electronic device 001 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components. The illustrated components can be realized in hardware, software or a combination of software and hardware.

Taking the smart TV 100 as an example of an electronic device, a system mode switching method provided by an embodiment of the present application will be described in detail below with reference to the accompanying drawings. The application provides a system mode switching method, which can complete the exit operation of the children's mode of the smart TV by recognizing the user's voice and the user's image. Therefore, the child mode exit operation path is short, and the usability is high. Moreover, user identification is accurate, and it is not easy to be bypassed by children.

The following describes the system mode switching method of the smart TV 100 in detail with reference to the flow chart shown in FIG. 4 .

Specifically, as shown in Figure 4, the method provided in this embodiment includes the following steps:

S100: The Smart TV runs in Kids Mode.

As shown in FIG. 5 , the current system mode of the smart TV 100 is the children's mode (ie, the first system mode). When the smart TV 100 is running in the children's mode, the source range, duration, and sitting posture of children watching the smart TV 100 are controlled. For example, when the smart TV 100 is running in the children's mode, the children need to sit and watch the video, which is a children's video, and the duration of watching the video is limited to 30 minutes. Then, the child sits on the sofa and can normally watch the video of the child playing football played on the smart TV 100, and the duration is 30 minutes. When the child is lying down and watching the video, the camera 101 of the smart TV 100 detects that the child is not sitting on the sofa, and the smart TV 100 stops playing the current video. For another example, when the child watches the current video for 30 minutes, the smart TV 100 also stops playing the current video.

S200: The smart TV acquires the voice of the user, and parses out the instructions from the voice.

When an adult needs to use the smart TV 100 to watch a video or after a child watches the video, and the adult switches the system mode of the smart TV 100 , the adult performs a voice wake-up to exit the children's mode. For example, as shown in FIG. 5, an adult says "Xiaoyi Xiaoyi, exit the child mode". "Xiaoyi Xiaoyi, exit child mode" is the wake-up voice (wake-up word + command word) sent by the user. Among them, the wake-up word is "Xiaoyi Xiaoyi", and the command word is "exit child mode".

Exemplarily, as shown in FIG. 5 , the above-mentioned wake-up voice is acquired by other electronic devices communicatively connected with the smart TV 100 , such as the sound box 200 (indicated by path ① in FIG. 5 ). The speaker 200 can transmit the wake-up voice to the smart TV 100, and the smart TV 100 analyzes the wake-up voice. Alternatively, the speaker 200 analyzes the wake-up voice by itself, and then sends the analyzed instruction to the smart TV 100 . Both the sound box 200 and the smart TV 100 analyze the wake-up voice, and finally the command parsed from the wake-up voice is: the smart TV 100 exits the child mode.

In addition, for example, the wake-up voice may also be acquired by other electronic devices communicatively connected with the smart TV 100 , such as a remote controller or a wearable device connected via Bluetooth. The process of waking up the speech analysis is the same as the above-mentioned way of using the speaker 200 . In addition, the wake-up voice may also be directly obtained by a built-in pickup in the smart TV 100 .

The above-mentioned wake-up voice may be pre-set in the electronic device by the user according to his own needs, or may be set before the electronic device leaves the factory. The embodiment of the present application does not limit the setting method of the wake-up voice.

S300: The smart TV determines that the instruction includes a preset wake-up word for switching the child mode.

Exemplarily, "exit children's mode" in the above instruction is a wake-up word for switching children's mode.

S400: The smart TV acquires a user image, and determines that the user includes an adult according to the user image.

Exemplarily, the smart TV 100 confirms that the user corresponding to the acquired user image and the user who issued the wake-up voice are the same person.

After the user makes the wake-up voice, the camera 101 of the smart TV 100 acquires the image of the user by detecting the sound source image, that is, the camera 101 collects the image of the user who made the wake-up voice (shown as the path ② in FIG. 5 ). Wherein, what the camera 101 acquires is the user image of the user in front of the smart TV 100 . "Before the smart TV 100" refers to "where the camera 101 of the smart TV 100 can reach". The processor of the smart TV 100 judges the user image captured by the camera 101 and determines that the user who made the wake-up voice is an adult, not a child. Then, the smart TV 100 satisfies the wake-up operation condition that triggers exiting the child mode.

Equivalently, the processor of the smart smart TV 100 combines the received wake-up voice and the collected portrait data to perform calculations and determine whether the conditions for triggering the exit from the children's mode are met. That is, when the user who makes the wake-up voice is an adult, the condition for triggering the exit of the child mode scene is met.

The above "camera 101 collects images of the user who made the wake-up voice" is realized, for example, in the following manner: after the smart TV 100 acquires the wake-up voice from the user, the smart TV 100 performs sound source recognition on the user's wake-up voice to determine The user's location when the voice is spoken, specifically the azimuth angle. That is, whether the user who sends out the wake-up voice is located on the left side of the sound collector (such as the above-mentioned speaker 200), or is facing the position of the sound collector, etc., and then adjusts the position of the camera 101 of the smart TV 100 according to the user's location. Shooting angles to accurately capture images of the user who made the wake-up voice.

In some possible implementation manners, the above-mentioned "camera 101 collects images of the user who issued the wake-up voice" is realized, for example, in the following manner: the camera 101 of the smart TV 100 captures image information in real time, and the processor of the smart TV 100 processes the captured image The information is used for face recognition based on face recognition technology. When it is determined to be a portrait, the mouth opening recognition is performed. When it is determined that the recognition result is an opening of the mouth ("opening the mouth" indicates that a wake-up voice is being issued), the portrait of the mouth is obtained to complete the identification. The wake-up voice is used for image acquisition.

Exemplarily, the user image collected by the camera 101 for the user who made the wake-up voice is a face, and face detection technology may be used to distinguish whether the user who made the wake-up voice is an adult or a child. Specifically, the processor's image-based AI face recognition. Exemplarily, AI face recognition can automatically extract facial feature values, which include, for example, skin texture, skin color, brightness, and wrinkle texture. Confirm whether the portrait is an adult or a child by means of facial feature values. Exemplarily, the above-mentioned user image (human face) is a static image, and the processor determines that the user includes an adult (user of a preset user type) according to the static image.

In addition, for example, the user corresponding to the acquired user image and the user who makes the wake-up voice are not necessarily the same person.

In some possible implementations, after the user sends out the wake-up voice, the camera 101 of the smart TV 100 collects the user image of the user in front of the smart TV, and the processor confirms whether the user image collected by the camera 101 contains an adult, and the adult may be The person who wakes up the voice may or may not be the one who made the wake-up voice, as long as there is an adult present. Exemplarily, the processor may confirm that the user corresponding to the user image is an adult or a child through the aforementioned AI face recognition. Or, in some possible implementations, the user is in a still standing posture, and the camera 101 of the smart TV 100 acquires an image of the user in a still standing posture, and the processor determines the height corresponding to the user image according to the height of the standing posture corresponding to the user image. The user is an adult or a child.

When the processor of the smart TV 100 determines that the user has issued a wake-up voice, and the users in front of the smart TV 100 include adults, that is, an adult is present to supervise the operation of exiting the children's mode, the condition for triggering the scene of exiting the children's mode is met.

In addition, in some possible implementations, after the user makes the wake-up voice, the processor of the smart TV 100 uses voiceprint recognition technology to confirm whether the user who made the wake-up voice is an adult, and at the same time, after the user makes the wake-up voice, the processor of the smart TV 100 The camera 101 collects a user image of the user in front of the smart TV, and the processor determines whether the user image collected by the camera 101 includes an adult. The process of the processor confirming whether the image of the user contains an adult is the same as that described in any of the above embodiments.

The theoretical basis of voiceprint recognition is that each voice has unique characteristics, through which the voices of different people can be effectively distinguished. Such unique characteristics are, for example, the size of the vocal cavities, specifically the throat, nasal cavity, and oral cavity. The shape, size, and position of these organs determine the tension of the vocal cords and the range of sound frequencies. That is, the magnitude of vocal cord tension and the range of sound frequencies are different between adults and children. Therefore, the collected user's vocal fold tension and sound frequency can be identified through the voiceprint recognition technology, so as to confirm whether the user who made the wake-up voice is an adult.

S500: The processor of the smart TV switches the smart TV 100 from the child mode to the common mode according to the instruction, the user image and the determined adult user.

Exemplarily, the processor of the smart TV 100 successfully triggers the scene of exiting the children's mode according to the above-mentioned "exiting the children's mode" instruction and determining that the instruction is issued by an adult. In this scenario, according to the user's image, the smart TV 100 is switched from the child mode to the normal mode (ie, the second system mode). That is, the operation of exiting the child mode of the smart TV 100 is completed.

Or, in some possible implementations, the processor of the smart TV 100 confirms that an adult has issued the above-mentioned "exit children's mode" command, and as described in the above embodiment, it is determined that there is an adult in front of the smart TV 100 (the adult is not necessarily the one who issued the instruction). If an adult who "exits the children's mode" is present, the smart TV 100 is switched from the children's mode to the normal mode.

Or, in some possible implementations, the processor of the smart TV 100 confirms that a user (adult or child) has issued the above-mentioned "exit children's mode" instruction, and the above-mentioned embodiment describes that there is an adult in front of the smart TV 100 (the An adult (not necessarily the one who issued "exit kid mode") is present to switch the smart TV 100 from the kid mode to the normal mode.

Since the operation of exiting the child mode is performed through the adult image and the wake-up voice issued by the adult, it can be ensured that an adult is present to supervise the exit of the child mode. Therefore, the switching security and accuracy of the system mode of the present application are high. Moreover, it is convenient for the user to switch the system mode of the smart TV 100 . Moreover, the physical components involved in this application are all existing components of the smart TV 100 , and no new physical components are added.

The acquisition of the above-mentioned user image is obtained through the camera 101 that comes with the smart TV 100 , but this application is not limited thereto. Image acquisition.

As mentioned above, in the case of using static user images for adult judgment, there is a possibility of imitation of adult static images, such as human cardboard, models, etc., which will lead to easy bypass of the above solution. In order to prevent the situation of successfully triggering the exit of the child mode due to imitating the static image of an adult, referring to FIG. 6 , in some possible implementations, the confirmation action of the adult user is required to successfully trigger the exit of the child mode.

Exemplarily, after the smart TV 100 satisfies the wake-up operation condition that triggers exiting the children's mode, referring to FIG. 6 , a confirmation window will be generated on the display screen of the smart TV 100 (for example, in the middle of the screen). That is, as described in S400 above, after the adult makes the wake-up voice, and it is determined that the user image captured by the camera 101 is an adult, it means that the condition for triggering the exit from the child mode scene is met. Then, a confirmation window will be displayed on the smart TV 100 . As shown in FIG. 6 , the confirmation window displays "Please wave your hand towards the screen to confirm exiting the child mode" and "gesture pattern". Equivalently, the smart TV 100 prompts the user to perform an operation of confirming to exit the child mode through the confirmation window.

At this point, the user makes a gesture of waving according to the prompt in the confirmation window. That is, the user's body movement is a hand-waving gesture. In response to the generation of the confirmation window, the smart TV 100 acquires the user image of the user in front of the smart TV 100 (shown in the path ③ in FIG. path shown). The processor of the smart TV 100 determines according to the user image that the user's action instruction is: confirm to exit the child mode. And the processor of the smart TV 100 determines whether the user image containing the "waving hand gesture" corresponds to an adult. That is, the smart TV 100 collects portraits and gesture operations through the camera 101, and jointly detects whether it is an adult performing the exit gesture operation.

The above-mentioned waving gesture can be static (single-frame analysis is sufficient), or dynamic (multi-frame coherent analysis is required).

Therefore, the processor determines that the user is an adult according to the above-mentioned action instruction of "confirming to exit the child mode" and from the user image. If the processor determines that the exit gesture operation is performed by an adult, the condition for confirming to exit the children's mode is met, and the smart TV 100 is switched from the children's mode to the normal mode. If the conditions for confirming to exit the children's mode are not satisfied, the smart TV 100 does not perform the operation of exiting the children's mode, and continues the previous play, etc. User identification is accurate and it is not easy to be bypassed by children.

Equivalently, in this embodiment, when the user wakes up and exits the children's mode through a specific wake-up word (such as "Xiaoyi Xiaoyi, exit the children's mode"), the camera 101 of the smart TV 100 completes the collection of the user's image described in the above-mentioned embodiment. , the smart TV 100 combines voice and portrait detection to determine whether a wake-up condition for exiting the children's mode is met.

If the wake-up condition is met, the user makes a specific gesture (such as: goodbye waving gesture) according to the prompt of the smart TV 100, and the smart TV 100 jointly judges the portrait captured by the camera 101 and the associated body gestures to determine whether the exit condition is met. Satisfy the conditions and complete the exit, otherwise continue to play before waking up.

That is, through the joint recognition of the adult portrait and the voice wake-up of the smart TV 100 , the wake-up from the child mode is completed; through the joint recognition of the adult portrait and the associated exit gesture, the exit from the child mode is completed. The smart TV 100 realizes switching from the child mode to the normal mode, and the system mode of the smart TV 100 is switched from the first system mode to the second system mode.

As shown in FIG. 7 , the smart TV 100 exits the children's mode, and the system mode of the smart TV 100 is switched from the children's mode to the normal mode. In the normal mode, the source range of the smart TV 100 for adults to watch is not limited. As shown in FIG. 7 , an adult sits on a sofa and watches a video of a person crossing a cliff.

It should be noted that, the above-mentioned body movement for the user to confirm exiting the child mode is a hand waving gesture. But the present application is not limited thereto. In some possible implementations, the gestures corresponding to the above body movements are, for example, two-finger gestures, one-finger sliding gestures, page-turning gestures, two-finger pinching movements, left-to-right gesture, right to left gesture, up gesture, down gesture, press gesture, open clenched fist, tap gesture, clap gesture, reverse clap gesture, fisted hand, pinch gesture, reverse pinch gesture, Spread finger gesture, Reverse spread finger gesture, etc.

The above gestures are all dynamic actions, that is, the generated action instructions are based on the dynamic actions. However, the present application is not limited thereto. In some possible implementation manners, the above action instructions are based on static actions. For example, the user makes a static gesture: a thumbs up gesture, and remains still. The camera 101 of the smart TV 100 collects the static action, and determines that the action command is: confirm to exit the child mode.

As mentioned above, after the smart TV 100 satisfies the wake-up operation condition for triggering the exit from the children’s mode, referring to FIG. "Gesture pattern". But the present application is not limited thereto. In some possible implementation manners, after the smart TV 100 satisfies the wake-up operation condition triggering exiting the child mode, no confirmation window will be generated on the display screen of the smart TV 100 . After the user sends out the wake-up voice, the user directly confirms the above-mentioned "gesture pattern" (such as waving gesture) to exit the children's mode.

The camera 101 acquires the user image of the user in front of the smart TV 100, and confirms that the user image contains a "waving hand gesture" (shown by ④ path in FIG. 6 ). Similarly, the processor of the smart TV 100 determines according to the user image that the user's action instruction is: confirm to exit the child mode. And determine whether the user image containing the "waving hand gesture" corresponds to an adult. That is, the smart TV 100 collects portraits and gesture operations through the camera 101, and jointly detects whether it is an adult performing the exit gesture operation.

Therefore, the display screen of the smart TV 100 does not generate a confirmation window, and the processor of the smart TV 100, according to the above-mentioned action instruction of "confirming and exiting the children's mode" and the user determined from the user image as an adult, satisfies the conditions for confirming and exiting the children's mode. The television 100 switches from the child mode to the normal mode.

To sum up, in the smart TV 100 of the present application, in the children’s mode, the awakening of exiting the children’s mode is completed through double joint recognition of voice and adult portrait; the confirmation of exiting the children’s mode is completed through the joint recognition of adult portrait and specific body gestures. And using the existing physical devices, without increasing the physical cost, it is more accurate and convenient for the personnel who meet the identity verification to quickly complete the exit of the child mode.

It should be noted that the above-mentioned first system mode is not limited to the children's mode. For example, in some possible implementation manners, the first system mode is a guest mode, such as a guest mode of a mobile phone. The switching method of the above-mentioned system mode is also applicable to exiting the guest mode. Exemplarily, the trigger method for exiting the visitor mode: double recognition of portrait + voice; the method for confirming the exit of the visitor mode: joint detection of adult portrait + associated body gestures.

It should be noted that, the above-mentioned embodiment describes switching from the first system mode taking the child mode as an example to the second system mode taking the normal mode as an example. In some possible implementation manners, it may be switched from the first system mode exemplified by the normal mode to the second system mode exemplified by the child mode.

Exemplarily, the method for system switching mode of the present application is applicable to a scenario involving switching from a low-privilege system mode to a high-privilege system mode. Switching from the first system mode to the second system mode requires higher permissions. The first system mode will not be easily switched to the second system mode. Certain authority verification is required to switch from the first system mode to the second system mode. . Then, the trigger method for switching from the first system mode to the second system mode: dual recognition of portrait + voice; the method of confirming the switch from the first system mode to the second system mode: joint detection of adult portrait + associated body gestures. This mode switching process is convenient and not easily bypassed.

Referring now to FIG. 8 , shown is a block diagram of an electronic device 400 in accordance with one embodiment of the present application. Electronic device 400 may include one or more processors 401 coupled to controller hub 403 . For at least one embodiment, the controller hub 403 communicates with a multi-drop bus such as a Front Side Bus (FSB, Front Side Bus), a point-to-point interface such as a QuickPath Interconnect (QPI, QuickPath Interconnect), or a similar connection 406. Processor 401 communicates. Processor 401 executes instructions that control data processing operations of a general type. In one embodiment, the controller hub 403 includes, but is not limited to, a graphics memory controller hub (GMCH, Graphics & Memory Controller Hub) (not shown) and an input/output hub (IOH, Input Output Hub) (which can be on a separate chip) (not shown), where the GMCH includes the memory and graphics controller and is coupled to the IOH.

Electronic device 400 may also include coprocessor 402 and memory 404 coupled to controller hub 403 . Alternatively, one or both of the memory and the GMCH may be integrated within the processor (as described in this application), with the memory 404 and coprocessor 402 directly coupled to the processor 401 and the controller hub 403, which 403 and IOH are in a single chip.

The memory 404 may be, for example, a dynamic random access memory (DRAM, Dynamic Random Access Memory), a phase change memory (PCM, Phase Change Memory), or a combination of the two. One or more tangible, non-transitory computer-readable media for storing data and/or instructions may be included in memory 404 . Computer-readable storage media have stored therein instructions, and in particular, temporary and permanent copies of the instructions. The instructions may include: instructions causing the electronic device 400 to implement the method shown in FIG. 4 when executed by at least one of the processors. When the instruction is run on the computer, the computer is made to execute the method disclosed in any one or combined embodiments above.

In one embodiment, the coprocessor 402 is a special-purpose processor, such as, for example, a high-throughput MIC (ManyIntegrated Core, integrated many-core) processor, a network or communication processor, a compression engine, a graphics processor, a GPGPU (General-purpose computing on graphics processing units, general computing on graphics processing units), or embedded processors, etc. The optional nature of coprocessor 402 is shown in Figure 8 with dashed lines.

In one embodiment, the electronic device 400 may further include a network interface (NIC, Network Interface Controller) 406 . The network interface 406 may include a transceiver for providing a radio interface for the electronic device 400 to communicate with any other suitable devices (such as front-end modules, antennas, etc.). In various embodiments, network interface 406 may be integrated with other components of electronic device 400 . The network interface 406 can implement the functions of the communication unit in the above-mentioned embodiments.

The electronic device 400 may further include an input/output (I/O, Input/Output) device 405 . I/O 405 may include: a user interface designed to enable a user to interact with electronic device 400; a peripheral component interface designed to enable peripheral components to also interact with electronic device 400; and/or sensors designed to determine environmental conditions and/or location information.

It should be noted that Fig. 8 is only exemplary. That is, although it is shown in FIG. 8 that the electronic device 400 includes multiple components such as the processor 401, the controller hub 403, and the memory 404, in actual applications, the devices using the methods of the present application may only include the electronic device 400 Some of the devices, for example, may only include the processor 401 and the network interface 406 . The properties of optional components in Figure 8 are shown with dashed lines.

Referring now to FIG. 9 , there is shown a block diagram of a SoC (System on Chip, System on Chip) 500 according to an embodiment of the present application. In Fig. 9, similar parts have the same reference numerals. Also, dashed boxes are optional features for more advanced SoCs. In FIG. 9, SoC 500 includes: interconnection unit 550, which is coupled to processor 510; system agent unit 580; bus controller unit 590; integrated memory controller unit 540; , which may include an integrated graphics logic, an image processor, an audio processor and a video processor; a static random access memory (SRAM, Static Random-Access Memory) unit 530; a direct memory access (DMA, Direct Memory Access) unit 560. In one embodiment, the coprocessor 520 includes a special-purpose processor, such as, for example, a network or communication processor, a compression engine, a GPGPU (General-purpose computing on graphics processing units, general-purpose computing on graphics processing units), a high-throughput MIC processor, or embedded processor, etc.

Static random access memory (SRAM) unit 530 may include one or more tangible, non-transitory computer-readable media for storing data and/or instructions. Computer-readable storage media have stored therein instructions, and in particular, temporary and permanent copies of the instructions. The instructions may include instructions that, when executed by at least one of the processors, cause the SoC to implement the method shown in FIG. 4 . When the instructions are run on the computer, the computer is made to execute the methods disclosed in the above-mentioned embodiments.

The method implementations of the present application can be implemented in software, magnetic components, firmware, and the like.

Program code can be applied to input instructions to perform the functions described herein and generate output information. The output information may be applied to one or more output devices in known manner. For the purposes of this application, a processing system includes any system having a processor such as, for example, a Digital Signal Processor (DSP), a microcontroller, an Application Specific Integrated Circuit (ASIC), or a microprocessor.

The program code can be implemented in a high-level procedural language or an object-oriented programming language to communicate with the processing system. Program code can also be implemented in assembly or machine language, if desired. In fact, the mechanisms described in this paper are not limited in scope to any particular programming language. In either case, the language may be a compiled or interpreted language.

One or more aspects of at least one embodiment can be implemented by representative instructions stored on a computer-readable storage medium, the instructions representing various logic in a processor, the instructions, when read by a machine, cause the machine to make The logic that implements the techniques of this article. These representations, referred to as "IP (Intellectual Property, Intellectual Property) cores," may be stored on a tangible computer-readable storage medium and provided to multiple customers or production facilities to be loaded into the in the manufacturing machine.

In some cases, an instruction converter may be used to convert instructions from a source instruction set to a target instruction set. For example, an instruction converter may transform (eg, using static binary translation, dynamic binary translation including dynamic compilation), warp, emulate, or otherwise convert an instruction into one or more other instructions to be processed by the core. The instruction converter can be implemented in software, hardware, firmware, or a combination thereof. The instruction converter can be on-processor, off-processor, or partly on-processor and partly off-processor.

Claims (13)

1. A system mode switching method applied to electronic equipment, characterized in that the method comprises: Run the first system mode; acquiring the voice of the user of the electronic device, and parsing out instructions from the voice; determining that the instruction includes a preset wake-up word for switching the first system mode; Acquire a user image collected for the user in front of the electronic device, and determine according to the user image that the user includes a user of a preset user type; According to the instruction, and according to the user image and the determined user of the preset user type, the electronic device is switched from the first system mode to the second system mode corresponding to the preset user type. 2. The system mode switching method according to claim 1, wherein the user image comprises a first user image and a second user image; The switching the electronic device from the first system mode to the second system mode corresponding to the preset user type according to the user image and the determined user of the preset user type according to the instruction includes: : generating a confirmation window according to the instruction and the user of the preset user type determined from the first user image; In response to the generation of the confirmation window, acquiring a user image collected by the user in front of the electronic device as the second user image, and determining an action instruction according to the second user image; Switching the electronic device from the first system mode to the second system mode corresponding to the preset user type according to the action instruction and the user of the preset user type determined from the second user image. 3. The system mode switching method according to claim 2, wherein the action instruction is a static based action. 4. The system mode switching method according to claim 2, wherein the action instruction is based on a dynamic action, and the dynamic action includes the user's body action. 5 . The system mode switching method according to claim 2 , wherein the first user image comprises a static image, and according to the static image, it is determined that the user includes a user of a preset user type. 6. The system mode switching method according to claim 1, wherein the user of the preset user type is the sender of the voice. 7. The system mode switching method according to claim 1, wherein, according to the instruction, and according to the user image and the determined preset user type, the electronic device is switched from the first system The mode is switched to the second system mode corresponding to the preset user type, including: determining an action instruction according to the user image; According to the instruction, and according to the determined user of the preset user type and the action instruction, the electronic device is switched from the first system mode to the second system mode corresponding to the preset user type. 8 . The system mode switching method according to claim 7 , wherein the user image comprises a static image, and according to the static image, it is determined that the user includes a user of a preset user type. 9. The system mode switching method according to claim 7, wherein the user image comprises a dynamic image, and the dynamic image includes body movements of the user. 10. The system mode switching method according to claim 4 or 9, characterized in that the body movement includes a hand waving gesture. 11. The system mode switching method according to any one of claims 1 to 10, wherein the user of the preset user type is an adult, the first system mode is a child mode, and the second system mode for normal mode. 12. An electronic device, characterized in that it comprises: The pickup is used to collect the voice of the user; camera, used to collect the user image of the user; processor; A memory, the memory includes instructions, and when the instructions are executed by the processor, the electronic device executes the system mode switching method according to any one of claims 1 to 11. 13. A computer-readable storage medium, wherein instructions are stored on the computer-readable storage medium, and when the instructions are executed on a computer, the computer performs the system mode switching according to any one of claims 1 to 11 method.

Images