CN112331202A - Voice screen projection method and device, electronic equipment and computer readable storage medium - Google Patents
Voice screen projection method and device, electronic equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN112331202A CN112331202A CN202011215991.7A CN202011215991A CN112331202A CN 112331202 A CN112331202 A CN 112331202A CN 202011215991 A CN202011215991 A CN 202011215991A CN 112331202 A CN112331202 A CN 112331202A
- Authority
- CN
- China
- Prior art keywords
- screen projection
- voice
- module
- target application
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- General Health & Medical Sciences (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention provides a voice screen projection method and device, electronic equipment and a computer readable storage medium. The voice screen projection method is applied to electronic equipment of an iOS system, and comprises the following steps: acquiring a voice control instruction through Siri; if the voice control instruction is matched with a preset voice instruction, calling a target shortcut matched with the voice instruction; and calling a screen projection function in the target application program according to the target shortcut. Therefore, the voice control instruction is obtained through the Siri, the shortcut function provided by the Siri is utilized, the screen projection function in the application program is called through the shortcut function under the condition that the voice control instruction is matched with the threshold voice instruction, the screen projection function is started through voice in the iOS device, and the user experience is improved.
Description
Technical Field
The present invention relates to the field of computer technology, and in particular, to a method and an apparatus for voice screen projection, an electronic device, and a computer-readable storage medium.
Background
The voice screen projection refers to a method for controlling one electronic device to project displayed content to another electronic device based on a voice control mode, for example, controlling the content displayed on a mobile phone to project on a television. However, the protocols supported by different electronic devices due to software and hardware are different. The existing iOS (apple Mobile operating System) equipment cannot realize voice control screen projection, and is inconvenient to operate.
Disclosure of Invention
The embodiment of the invention provides a voice screen projection method and device, electronic equipment and a computer readable storage medium, and aims to solve the problem that the conventional iOS equipment cannot realize voice control screen projection.
The specific technical scheme is as follows:
in a first aspect of the present invention, there is provided a voice screen projection method applied to an electronic device of an iOS system, where the voice screen projection method includes the following steps:
acquiring a voice control instruction through Siri;
if the voice control instruction is matched with a preset voice instruction, calling a target shortcut matched with the voice instruction;
and calling a screen projection function in the target application program according to the target shortcut.
Optionally, before invoking a screen projection function in the target application according to the target shortcut, the method includes:
acquiring the starting type of the target application program;
when the starting type is cold starting, converting a system intention object transmitted by Siri into an intention object matched with the target application program through the Siri processing center, wherein the system intention object is generated according to the voice control instruction;
and matching the intention object with a preset control command in the target application program.
Optionally, the invoking a screen projection function in a target application according to the target shortcut includes:
if the intention object is matched with a preset control command of the screen projection module, waking up the player;
processing video data by the player;
and projecting a screen according to the video data processed by the player by using an Airplay.
Optionally, after the matching the intention object with the preset control command in the target application, the method further includes:
if the intention object is matched with a preset control command of a target service module, calling the target service module according to the intention object, wherein the target service module is a functional module in the target application program except for a screen projection module;
if a matching protocol exists between the target service module and the screen projection module, calling the screen projection module according to the matching protocol, and executing the step of awakening the player.
Optionally, before obtaining the voice control instruction through Siri, the method further includes:
receiving definition input of a keyword for starting a screen projection function, and generating a preset control command for starting the screen projection function according to the keyword;
after the screen projection function in the target application program is called according to the target shortcut, the method further comprises the following steps:
counting the use frequency of the screen projection function;
and if the using frequency of the screen projection function is greater than a preset threshold value, expanding and starting keywords corresponding to the screen projection function.
In another aspect of the present invention, there is also provided a voice screen projection apparatus applied to an electronic device of an iOS system, including:
the instruction acquisition module is used for acquiring a voice control instruction through Siri;
the matching module is used for calling a target shortcut matched with the voice instruction if the voice control instruction is matched with a preset voice instruction;
and the calling module is used for calling the screen projection function in the target application program according to the target shortcut.
Optionally, the method further includes:
the starting type obtaining module is used for obtaining the starting type of the target application program;
a conversion module, configured to, when the boot type is a cold boot, convert a system intention object, which is introduced by Siri, into an intention object matched with the target application program through the Siri processing center, where the system intention object is generated according to the voice control instruction;
and the intention matching module is used for matching the intention object with a preset control command in the target application program.
Optionally, the invoking module includes:
the awakening sub-module is used for awakening the player if the intention object is matched with a preset control command of the screen projection module;
the data processing module is used for processing the video data through the player;
and the screen projection sub-module is used for projecting a screen according to the video data processed by the player by using the airlay.
In another aspect of the present invention, there is also provided an electronic device, including a processor, a communication interface, a memory and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing the steps of the voice screen projection method when executing the program stored in the memory.
In yet another aspect of the present invention, there is also provided a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the voice screen projection method as described in any one of the above.
Therefore, the voice control instruction is obtained through the Siri, the shortcut function provided by the Siri is utilized, the screen projection function in the application program is called through the shortcut function under the condition that the voice control instruction is matched with the threshold voice instruction, the screen projection function is started through voice in the iOS device, and the user experience is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
FIG. 1 is a flowchart of a voice screen projection method according to an embodiment of the present invention;
fig. 2A is a flowchart illustrating a screen projection module implementing a screen projection function according to an embodiment of the present invention;
fig. 2B is a flowchart of a service module implementing a screen projection function in an embodiment of the present invention;
FIG. 2C is a flowchart illustrating a voice screen projection method according to an embodiment of the present invention;
FIG. 3 is a block diagram of a voice screen projection apparatus according to an embodiment of the present invention;
fig. 4 is a block diagram of an electronic device according to an embodiment of the invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described below with reference to the drawings in the embodiments of the present invention.
The invention provides a voice screen projection method.
The electronic equipment realizes the screen projection function and is related to the support of software and hardware equipment, generally speaking, the screen projection of the electronic equipment is realized based on two protocols of Airplay and DLNA (DIGITAL LIVING NETWORK ALLIANCE), wherein the screen projection initiating end of the screen projection function realized based on Airplay is the electronic equipment of the iOS system. However, the existing iOS system needs to open an application program to implement the screen projection function, find an entry of the screen projection function in a page, and start the screen projection function through manual operation, which is inconvenient to use.
The technical solution of the present invention is applied to an electronic device of an iOS system (apple mobile operating system), and particularly, to an electronic device with an operating system version of iOS12 or more, where the electronic device may include, but is not limited to, a smart phone, a tablet computer, and the like of the iOS system.
In an embodiment of the present invention, the voice screen projection method includes the following steps:
step 101: and acquiring a voice control instruction through Siri.
Step 102: and if the voice control instruction is matched with a preset voice instruction, calling a target shortcut matched with the voice instruction.
Step 103: and calling a screen projection function in the target application program according to the target shortcut.
In this embodiment, the voice command is obtained by an apple intelligent voice assistant Siri built in the iOS system, and specifically, the voice control command input by the user is obtained by Siri in a state where Siri is started.
In the embodiment, the utilization of the Siri call is realized by a shortcut function (Siri Shortcuts) provided by Siri. Specifically, the shortcut configuration of the target application program is completed according to the configuration requirement required by the shortcut function of the Siri, and then the shortcut of the target application program is added to the shortcut interface provided by the Siri, so that the Siri is utilized to wake up the target application program, and the screen projection function in the target application program is called to realize quick screen projection.
In implementation, a voice instruction for invoking the screen-projection function needs to be preset, for example, the preset voice instruction may be recorded in a specific interface by a user, and if a voice control instruction input by the user through Siri matches the voice instruction, the screen-projection function is invoked.
In one embodiment, when configuring the shortcut function, first, an intention Definition File (Siri Intent Definition File) needs to be generated and related configuration needs to be completed, and specifically, the information that needs to be determined includes an adapted model, a Siri plugin id, a localization File, and the like.
Next, a Media intent file (Siri Media entries) having an extension of. appex and an intent definition file having an extension of. intent definition are created.
Next, a property list file is created, and relevant elements, such as a title (title), a subTitle (subTitle), a suggestion (comment), identity information (identity), etc., are added to the property list file, and the number list file is used as an instruction file to further explain information such as specific use functions and use methods to the user. For example, corresponding menu options may be generated in the operating system as the description information.
Next, further configuration of the application program is required. Specifically, the created media intention file is added to a framework (framework) of a main project, a sirhsortcutsc processing center (hereinafter, referred to as "Siri processing center") is created by using a singleton schema, and then the intention definition file is associated with the target application program.
When the target application program is started, a registered Siri shortcut provided by a Siri processing center is called, whether a user system is larger than the iOS12 is judged internally for the Siri pull-up behavior, and the processing center injects a title, a subTitle and an identity field in a media intention file and caches the fields in the main project of the target application program. It should be appreciated that the shortcut function provided by Siri only supports operating systems above version iOS12, and therefore, a determination of the version of the user system is required.
Further, voice commands corresponding to all service modules in the target application program are created, and the voice commands are transmitted in communication with all the service modules, wherein parameters comprise a distinguishing intention function object (TIntertType), a description (caption) and a sound file (voiceText).
Here, the service module refers to a software module that implements different functions in an application, for example, the function module may refer to a screen projection module that implements a screen projection function, may also refer to an offline video playing module that plays an offline video, and may also refer to a search module that implements a search function, and specifically, the service module in each application may be set according to actual needs.
When a user triggers and adjusts a voice command in system setting or in a target application program, the operation behavior of the user is monitored to acquire the latest state of the voice command. Here, the adjusting voice command may specifically refer to a change operation for a voice command, such as adding, deleting, and modifying a voice command.
Specifically, the cache data of the Siri processing center can be obtained and updated again when the recording page is called by the Siri processing center in the target application program through monitoring foreground and background switching. Further, the Siri processing center converts the voice command input by the user into an object, retrieves the intention type, distributes a task of page jump, and monitors the switching of the application foreground and background to update the voice command recorded by the user.
In addition, the adjustment of the voice command may be performed in a page within the target application. Specifically, an interface for a user to record voice instructions in a target application program is created through the Siri processing center.
The target shortcut in this embodiment refers to a shortcut configured in the above manner and used for calling the screen projection module to start the screen projection function.
Therefore, the voice control instruction is obtained through the Siri, the shortcut function provided by the Siri is utilized, the screen projection function in the application program is called through the shortcut function under the condition that the voice control instruction is matched with the threshold voice instruction, the screen projection function is started through voice in the iOS device, and the user experience is improved.
In some embodiments, before invoking a screen projection function in a target application according to the target shortcut, the method includes:
acquiring the starting type of the target application program;
when the starting type is cold starting, converting a system intention object transmitted by Siri into an intention object matched with the target application program through the Siri processing center, wherein the system intention object is generated according to the voice control instruction;
and matching the intention object with a preset control command in the target application program.
The starting of the application program generally comprises two starting modes, namely a cold starting mode and a hot starting mode, wherein the cold starting mode refers to that the application program is switched from a killing state to a running state, and the hot starting mode refers to that the application program is switched from a background running state to a foreground running state. The technical solution of this embodiment mainly aims at the cold start state of the application program.
It should be understood that, when an application is in a killed state, since there is no process in which the application runs, the application in the killed state in the iOS system cannot be called in the related art.
In this embodiment, the start type of the target application program is first obtained, specifically, it may be determined whether a background process of the target application program exists through a Siri processing center, and if the background process does not exist, it indicates that the start type of the target application program is cold start.
Next, the system intent objects imported by Siri are converted into intent objects that match the target application. It should be understood that after receiving the voice control command, Siri generates a corresponding system intention object according to the voice control command, the format of the system intention object is set by the iOS system, and the intention object of the target application is set by the developer of the target application, so that the system intention object is different from the format of the intention object in the target application, and format conversion is required to convert the system intention object into the intention object matched with the target application.
Further, the intention object obtained by conversion is matched with a preset control command in the target application program, specifically, the preset control command refers to the intention object obtained by conversion of the preset voice instruction and matched with the target application program.
In some embodiments, the invoking a screen projection function in a target application according to the target shortcut includes:
if the intention object is matched with a preset control command of the screen projection module, waking up the player;
processing video data by the player;
and projecting the screen according to the video data processed by the player by utilizing an Airplay.
If the intention object obtained by format conversion of the system intention object is matched with the preset command for calling the screen projection module, a built-in player of the operating system is awakened through the screen projection module, video data is processed by the player, and further, the built-in Airplay of the system is called to realize screen projection.
As shown in fig. 2A, the process of implementing the screen projection function based on the Airplay may be summarized as that the front end carries relevant information such as tvid (television account), aid (apple account), and login information, and sends the relevant information to VRS (video reference series technology), and requests an interface (API) of the back end, the interface returns an m3u8 (a file format) address to the front end, the front end calls an interface of the apple device to implement calling a player in the iOS system, and the player in the iOS system plays data with the player, and outputs a picture through an output device, where the output device refers to a device in which a television box, a television, a display, and the like directly display a picture.
In some embodiments, after the matching the intention object with the preset control command in the target application, the method further comprises:
if the intention object is matched with a preset control command of a target service module, calling the target service module according to the intention object, wherein the target service module is a functional module in the target application program except for a screen projection module;
if a matching protocol exists between the target service module and the screen projection module, calling the screen projection module according to the matching protocol, and executing the step of awakening the player.
As shown in fig. 2B, after Siri invokes a target application, module instructions for invoking different service modules need to be distributed, and if a screen-projecting module is directly invoked, a screen-projecting function is directly implemented by using the screen-projecting module.
If the intention object obtained by the system intention object through format conversion is matched with a target service module except for the calling screen projection module, whether a matching protocol exists between the target service module and the screen projection module needs to be further determined.
For example, in this embodiment, the target application further includes an offline video playing module and a searching module, and if the intention object matches with the offline video playing module or the searching module, and both the offline video playing module and the searching module have matching protocols matching with the screen projection module, the intention object is further associated according to the matching protocols.
Specifically, a search module is called first, and then a screen projection module is called according to a matching protocol 1 to realize a screen projection function; or firstly calling an offline video playing module, and then calling a screen projection module according to the matching protocol 2 to realize the screen projection function.
In some embodiments, obtaining the voice control instruction by Siri further comprises:
receiving definition input of a keyword for starting a screen projection function, and generating a preset control command for starting the screen projection function according to the keyword;
after the screen projection function in the target application program is called according to the target shortcut, the method further comprises the following steps:
counting the use frequency of the screen projection function;
and if the using frequency of the screen projection function is greater than a preset threshold value, expanding and starting keywords corresponding to the screen projection function.
In this embodiment, the keywords may be manually input by the user, or may be obtained by analyzing a voice instruction input by the user. Furthermore, if the statistical screen projection function has high use frequency, the user is proved to be an active user of the screen projection function, so that more keywords are further issued, the matching range of the intention object corresponding to the screen projection module is improved, the success rate of starting the screen projection function is improved, and the user experience is further enriched.
As shown in fig. 2C, the technical solution of this embodiment may be summarized as triggering Siri, obtaining an input voice control instruction through Siri, and if the voice control instruction is a command corresponding to Siri, for example, corresponding to another service provided by Siri, performing a corresponding operation with reference to a related technology.
If the voice control instruction is the voice instruction corresponding to the target application program, or the intention instruction, the target application program is opened.
After the target application is opened and the program is changed, triggering a corresponding business module according to the intention instruction, wherein the business module can be a screen projection module; possibly other service modules which are out of the screen projection module and have a matching protocol with the screen projection module; other service modules may be outside the screen projection module and have no matching protocol with the screen projection module.
In the case that the service module is a screen projection module or is other than the screen projection module, and has a protocol matching with the screen projection module, the screen projection function can be implemented with reference to the method shown in fig. 2B.
If the service module is other than the screen projection module and the screen projection module does not have other service modules with matching protocols, corresponding operations are executed through the service module, and details are not repeated here.
In another aspect of the implementation of the present invention, a voice screen projection apparatus is further provided, which is applied to an electronic device of an iOS system.
As shown in fig. 3, in one embodiment, the voice screen projecting apparatus 300 includes:
an instruction obtaining module 301, configured to obtain a voice control instruction through Siri;
a matching module 302, configured to invoke a target shortcut matched with the voice instruction if the voice control instruction matches with a preset voice instruction;
and the calling module 303 is configured to call a screen projection function in the target application program according to the target shortcut.
In some embodiments, further comprising:
the starting type obtaining module is used for obtaining the starting type of the target application program;
a conversion module, configured to, when the boot type is a cold boot, convert a system intention object, which is introduced by Siri, into an intention object matched with the target application program through the Siri processing center, where the system intention object is generated according to the voice control instruction;
and the intention matching module is used for matching the intention object with a preset control command in the target application program.
In some embodiments, the invoking module 303 comprises:
the awakening sub-module is used for awakening the player if the intention object is matched with a preset control command of the screen projection module;
the data processing module is used for processing the video data through the player;
and the screen projection sub-module is used for projecting a screen according to the video data processed by the player by utilizing the Airplay.
In some embodiments, further comprising:
the calling module is also used for calling the target business module according to the intention object if the intention object is matched with a preset control command of the target business module, wherein the target business module is a functional module in the target application program except for a screen projection module;
and the protocol matching module is used for calling the screen projection module according to the matching protocol and executing the step of awakening the player if the matching protocol exists between the target service module and the screen projection module.
In some embodiments, further comprising:
the keyword definition module is used for receiving definition input of a keyword for starting the screen projection function and generating a preset control command for starting the screen projection function according to the keyword;
the statistical module is used for counting the use frequency of the screen projection function;
and the keyword expansion module is used for expanding and starting the keywords corresponding to the screen projecting function if the using frequency of the screen projecting function is greater than a preset threshold value.
An embodiment of the present invention further provides an electronic device, as shown in fig. 4, including a processor 41, a communication interface 42, a memory 43, and a communication bus 44, where the processor 41, the communication interface 42, and the memory 44 complete mutual communication through the communication bus 44,
a memory 43 for storing a computer program;
when the electronic device is the terminal device, the processor 41 is configured to implement any one of the steps of the voice screen projection method when executing the program stored in the memory.
In yet another aspect of the present invention, there is also provided a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the voice screen projection method as described in any one of the above.
The communication bus mentioned in the above terminal may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this does not mean that there is only one bus or one type of bus.
The communication interface is used for communication between the terminal and other equipment.
The Memory may include a Random Access Memory (RAM) or a non-volatile Memory (non-volatile Memory), such as at least one disk Memory. In some embodiments, the memory may also be at least one storage device located remotely from the aforementioned processor.
The Processor may be a general-purpose Processor, and includes a Central Processing Unit (CPU), a NetworK Processor (NP), and the like; the Integrated Circuit may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, a discrete Gate or transistor logic device, or a discrete hardware component.
In yet another embodiment of the present invention, there is also provided a computer-readable storage medium having stored therein instructions, which when run on a computer, cause the computer to perform the modeling method of any one of the above embodiments.
In a further embodiment provided by the present invention, there is also provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the modeling method of any of the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to occur, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another, for example, from one website site, computer, server, or data center to another website site, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that incorporates one or more of the available media. The usable medium may be a magnetic medium (e.g., floppy DisK, hard DisK, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., Solid State DisK (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for the system embodiment, since it is substantially similar to the method embodiment, the description is simple, and for the relevant points, reference may be made to the partial description of the method embodiment.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (10)
1. A voice screen projection method is applied to electronic equipment of an iOS system, and comprises the following steps:
acquiring a voice control instruction through Siri;
if the voice control instruction is matched with a preset voice instruction, calling a target shortcut matched with the voice instruction;
and calling a screen projection function in the target application program according to the target shortcut.
2. The voice screen projection method of claim 1, wherein before calling a screen projection function in a target application according to the target shortcut, the method comprises:
acquiring the starting type of the target application program;
when the starting type is cold starting, converting a system intention object transmitted by Siri into an intention object matched with the target application program through the Siri processing center, wherein the system intention object is generated according to the voice control instruction;
and matching the intention object with a preset control command in the target application program.
3. The voice screen projection method of claim 2, wherein the calling of the screen projection function in the target application according to the target shortcut comprises:
if the intention object is matched with a preset control command of the screen projection module, waking up the player;
processing video data by the player;
and projecting the screen according to the video data processed by the player by utilizing an Airplay.
4. The voice screen projection method of claim 3, wherein after matching the intention object with a preset control command in the target application, further comprising:
if the intention object is matched with a preset control command of a target service module, calling the target service module according to the intention object, wherein the target service module is a functional module in the target application program except for a screen projection module;
if a matching protocol exists between the target service module and the screen projection module, calling the screen projection module according to the matching protocol, and executing the step of awakening the player.
5. The voice screen projection method according to any one of claims 1 to 4, wherein before obtaining the voice control instruction by Siri, the method further comprises:
receiving definition input of a keyword for starting a screen projection function, and generating a preset control command for starting the screen projection function according to the keyword;
after the screen projection function in the target application program is called according to the target shortcut, the method further comprises the following steps:
counting the use frequency of the screen projection function;
and if the using frequency of the screen projection function is greater than a preset threshold value, expanding and starting keywords corresponding to the screen projection function.
6. A voice screen projection device is applied to electronic equipment of an iOS system, and comprises the following components:
the instruction acquisition module is used for acquiring a voice control instruction through Siri;
the matching module is used for calling a target shortcut matched with the voice instruction if the voice control instruction is matched with a preset voice instruction;
and the calling module is used for calling the screen projection function in the target application program according to the target shortcut.
7. The voice screen-projecting device of claim 6, further comprising:
the starting type obtaining module is used for obtaining the starting type of the target application program;
a conversion module, configured to, when the boot type is a cold boot, convert a system intention object, which is introduced by Siri, into an intention object matched with the target application program through the Siri processing center, where the system intention object is generated according to the voice control instruction;
and the intention matching module is used for matching the intention object with a preset control command in the target application program.
8. The voice screen-projection device of claim 7, wherein the invoking module comprises:
the awakening sub-module is used for awakening the player if the intention object is matched with a preset control command of the screen projection module;
the data processing module is used for processing the video data through the player;
and the screen projection sub-module is used for projecting a screen according to the video data processed by the player by using the airlay.
9. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the steps of the voice screen projection method of any one of claims 1 to 5 when executing the program stored in the memory.
10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the voice screen projection method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011215991.7A CN112331202B (en) | 2020-11-04 | 2020-11-04 | Voice screen projection method and device, electronic equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011215991.7A CN112331202B (en) | 2020-11-04 | 2020-11-04 | Voice screen projection method and device, electronic equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112331202A true CN112331202A (en) | 2021-02-05 |
| CN112331202B CN112331202B (en) | 2024-03-01 |
Family
ID=74323719
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011215991.7A Active CN112331202B (en) | 2020-11-04 | 2020-11-04 | Voice screen projection method and device, electronic equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112331202B (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113138737A (en) * | 2021-04-16 | 2021-07-20 | 阿波罗智联(北京)科技有限公司 | Display control method, device, equipment, medium and program product for screen projection scene |
| CN113362820A (en) * | 2021-05-26 | 2021-09-07 | 北京奇艺世纪科技有限公司 | Voice information response method and device, electronic equipment and storage medium |
| CN114827690A (en) * | 2022-03-30 | 2022-07-29 | 北京奇艺世纪科技有限公司 | Network resource display method, device and system |
| CN115174990A (en) * | 2022-06-30 | 2022-10-11 | 深圳创维－Rgb电子有限公司 | Voice screen projection method, device, equipment and computer readable storage medium |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030169233A1 (en) * | 1999-07-06 | 2003-09-11 | Hansen Karl C. | System and method for communication with enhanced optical pointer |
| US20090132926A1 (en) * | 2007-11-21 | 2009-05-21 | Samsung Electronics Co., Ltd. | Interactive presentation system and authorization method for voice command controlling interactive presentation process |
| US20150070319A1 (en) * | 2013-09-09 | 2015-03-12 | Timothy R. Pryor | Human interfaces for homes, medical devices and vehicles |
| US20170061443A1 (en) * | 2015-09-01 | 2017-03-02 | Echostar Technologies L.L.C. | Automated voice-based customer service |
| CN109448709A (en) * | 2018-10-16 | 2019-03-08 | 华为技术有限公司 | A kind of terminal throws the control method and terminal of screen |
| CN109586929A (en) * | 2017-09-28 | 2019-04-05 | 阿里巴巴集团控股有限公司 | The transmission method and device of conference content |
| CN110097883A (en) * | 2018-06-01 | 2019-08-06 | 苹果公司 | Voice interaction for accessing calling functionality of companion device at primary device |
| CN110310638A (en) * | 2019-06-26 | 2019-10-08 | 芋头科技（杭州）有限公司 | Throw screen method, apparatus, electronic equipment and computer readable storage medium |
| CN110381197A (en) * | 2019-06-27 | 2019-10-25 | 华为技术有限公司 | Many-one throws the processing method of screen sound intermediate frequency data, apparatus and system |
| CN111190558A (en) * | 2018-11-15 | 2020-05-22 | 腾讯科技（深圳）有限公司 | Screen projection control method and device, computer readable storage medium and computer equipment |
| CN111666119A (en) * | 2019-03-06 | 2020-09-15 | 华为终端有限公司 | UI component display method and electronic equipment |
| CN111666113A (en) * | 2020-04-24 | 2020-09-15 | 北京奇艺世纪科技有限公司 | Application program starting management method and device, electronic equipment and storage medium |
-
2020
- 2020-11-04 CN CN202011215991.7A patent/CN112331202B/en active Active
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030169233A1 (en) * | 1999-07-06 | 2003-09-11 | Hansen Karl C. | System and method for communication with enhanced optical pointer |
| US20090132926A1 (en) * | 2007-11-21 | 2009-05-21 | Samsung Electronics Co., Ltd. | Interactive presentation system and authorization method for voice command controlling interactive presentation process |
| US20150070319A1 (en) * | 2013-09-09 | 2015-03-12 | Timothy R. Pryor | Human interfaces for homes, medical devices and vehicles |
| US20170061443A1 (en) * | 2015-09-01 | 2017-03-02 | Echostar Technologies L.L.C. | Automated voice-based customer service |
| CN109586929A (en) * | 2017-09-28 | 2019-04-05 | 阿里巴巴集团控股有限公司 | The transmission method and device of conference content |
| CN110097883A (en) * | 2018-06-01 | 2019-08-06 | 苹果公司 | Voice interaction for accessing calling functionality of companion device at primary device |
| CN109448709A (en) * | 2018-10-16 | 2019-03-08 | 华为技术有限公司 | A kind of terminal throws the control method and terminal of screen |
| CN111190558A (en) * | 2018-11-15 | 2020-05-22 | 腾讯科技（深圳）有限公司 | Screen projection control method and device, computer readable storage medium and computer equipment |
| CN111666119A (en) * | 2019-03-06 | 2020-09-15 | 华为终端有限公司 | UI component display method and electronic equipment |
| CN110310638A (en) * | 2019-06-26 | 2019-10-08 | 芋头科技（杭州）有限公司 | Throw screen method, apparatus, electronic equipment and computer readable storage medium |
| CN110381197A (en) * | 2019-06-27 | 2019-10-25 | 华为技术有限公司 | Many-one throws the processing method of screen sound intermediate frequency data, apparatus and system |
| CN111666113A (en) * | 2020-04-24 | 2020-09-15 | 北京奇艺世纪科技有限公司 | Application program starting management method and device, electronic equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 李志刚;: "全新爱奇艺电视果, 用人工智能投屏看电视", 电器, no. 05 * |
| 解元;: "《袋鼠遥控》看电视用"说"的", 计算机与网络, no. 04 * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113138737A (en) * | 2021-04-16 | 2021-07-20 | 阿波罗智联(北京)科技有限公司 | Display control method, device, equipment, medium and program product for screen projection scene |
| CN113138737B (en) * | 2021-04-16 | 2023-11-03 | 阿波罗智联(北京)科技有限公司 | Display control method, device, equipment, medium and program product for screen-throwing scene |
| US11955039B2 (en) | 2021-04-16 | 2024-04-09 | Apollo Intelligent Connectivity (Beijing) Technology Co., Ltd. | Method and apparatus for controlling display in a screen projection scenario, device and program product |
| CN113362820A (en) * | 2021-05-26 | 2021-09-07 | 北京奇艺世纪科技有限公司 | Voice information response method and device, electronic equipment and storage medium |
| CN114827690A (en) * | 2022-03-30 | 2022-07-29 | 北京奇艺世纪科技有限公司 | Network resource display method, device and system |
| CN114827690B (en) * | 2022-03-30 | 2023-07-25 | 北京奇艺世纪科技有限公司 | Network resource display method, device and system |
| CN115174990A (en) * | 2022-06-30 | 2022-10-11 | 深圳创维－Rgb电子有限公司 | Voice screen projection method, device, equipment and computer readable storage medium |
| CN115174990B (en) * | 2022-06-30 | 2024-06-11 | 深圳创维－Rgb电子有限公司 | Voice screen projection method, device, equipment and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112331202B (en) | 2024-03-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112331202B (en) | Voice screen projection method and device, electronic equipment and computer readable storage medium | |
| US9807218B2 (en) | Method for filtering spam in electronic device and the electronic device | |
| CN109474843B (en) | Method for voice control of terminal, client and server | |
| EP3561643B1 (en) | Method and terminal for implementing voice control | |
| US10931755B2 (en) | Method and apparatus for managing a shared storage system | |
| CN109448709A (en) | A kind of terminal throws the control method and terminal of screen | |
| CN109388625B (en) | Method and device for processing configuration file in multi-distributed file system | |
| CN113242314B (en) | Cross-terminal resource access method, device, storage medium and electronic equipment | |
| CN111372115B (en) | Application program access method and device and communication system | |
| CN113194450A (en) | Bluetooth device management method and device | |
| CN103279485A (en) | Method and device for resource sharing | |
| CN110798701B (en) | Video update pushing method and terminal | |
| CN115185717A (en) | Interface calling method and device, electronic equipment and storage medium | |
| AU2018403361B2 (en) | Data transmission | |
| WO2016173075A1 (en) | System switching method and device | |
| KR101400799B1 (en) | Method and system for stroring and managing device control information to user terminal and method and user terminal for executing application using the same | |
| CN119166555A (en) | Method, device, equipment and storage medium for obtaining device information of access device | |
| CN113766345B (en) | Method for playing random push video and set top box | |
| CN113766362B (en) | Remote control method, device, electronic device and storage medium | |
| CN111356006B (en) | Video playing method, device, server and storage medium | |
| CN112182027B (en) | Information query method, device, electronic equipment and storage medium | |
| CN111132104B (en) | Method and device for searching mobile terminal | |
| CN104506896B (en) | The operation processing method and device of smart television | |
| CN112732098B (en) | Input method and related device | |
| CN115633215B (en) | Audio playing method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |