CN118354022A

CN118354022A - Server, electronic equipment and video call switching method

Info

Publication number: CN118354022A
Application number: CN202410371842.1A
Authority: CN
Inventors: 郭绪兵
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2024-03-29
Filing date: 2024-03-29
Publication date: 2024-07-16

Abstract

Some embodiments of the application provide a server, an electronic device and a video call forwarding method. After the user inputs the voice command, the electronic equipment detects the command type of the voice command, and the command type is a video call transfer command, and then the voice command is sent to the server. The server detects the source equipment which is executing the video call process, and acquires the target equipment according to the video call transfer instruction. The server sends a data transfer instruction to the source equipment so that the source equipment sends the received video call data to the server; and sending a data acquisition instruction to the target device so that the target device acquires the user data and sends the user data to the server. The server sends the video call data to the target equipment so that the target equipment plays the video call data; and transmitting the user data to the source device so that the source device performs a video call process according to the user data. The user can switch the electronic equipment to carry out video call only by voice control, and the operation is simple and convenient.

Description

Server, electronic equipment and video call switching method

Technical Field

The present application relates to the field of display devices, and in particular, to a server, an electronic device, and a video call forwarding method.

Background

The electronic device, such as a smart television, a refrigerator smart screen, a smart sound box and the like, can provide playing pictures, such as audio, video, pictures and the like, for users, such as network video programs and live television programs, and can also provide various application and service contents, such as network games, AI fitness, online education and the like for users.

The electronic equipment supporting the display function can be provided with a video call application, and a local terminal user can start the video call application and conduct video call with friends through the display screen. The video call function is bound with the user account, and the user needs to log in the user account in the video call application and then control the video call application to perform video call.

When having multiple electronic devices, a user may have a need to switch the electronic devices to conduct a video call. For example, a user may use a living room television to make a video call when he wants to go back to rest in a bedroom and continue the video call. However, limited to the security considerations of user account login, only one electronic device can login to the user account. The user needs to start a video call application in the bedroom electronic equipment, log in the user account again, and then conduct video call. Therefore, when the user switches the electronic equipment to carry out video call each time, the user needs to log in the user account again, and the operation is complicated.

Disclosure of Invention

The application provides a server, electronic equipment and a video call transfer method, which are used for solving the problem that in the related art, a user needs to log in a user account again every time the user switches the electronic equipment to perform video call, and the operation is complicated.

In a first aspect, some embodiments of the present application provide a server including a communication module and a control module. Wherein the communication module is configured to establish a communication connection with the electronic device; the control module is configured to:

detecting a source device in response to a voice command sent by the electronic device; the instruction type of the voice instruction is a video call transfer instruction;

Acquiring target equipment according to the video call transfer instruction;

Transmitting a data transfer instruction to the source equipment so that the source equipment transmits the received video call data to the server; and sending a data acquisition instruction to the target equipment so that the target equipment acquires user data and sends the user data to a server; the user data comprises audio and video data transmitted when the video call function is executed;

Transmitting the video call data to the target equipment so that the target equipment plays the video call data; and transmitting the user data to the source equipment so that the source equipment executes a video call process according to the user data.

In a second aspect, some embodiments of the present application provide an electronic apparatus including a display, a communicator, a device interface, and a controller. Wherein the communicator is configured to establish a communication connection with the server; the device interface is configured to be connected with a sound collector, and the sound collector is used for collecting user voice; the controller is configured to:

responding to a voice command input by a user, and detecting the command type of the voice command;

If the instruction type is a video call transfer instruction, the voice instruction is sent to a server;

Responding to a data acquisition instruction sent by a server, acquiring user data and sending the user data to the server so that the server can send the user data to source equipment, wherein the user data comprises audio and video data transmitted when a video call function is executed;

And receiving video call data sent by the server and playing the video call data, wherein the video call data is sent to the server by the source equipment.

In a third aspect, some embodiments of the present application provide a video call forwarding method, applied to a server, including:

Acquiring target equipment according to the video call transfer instruction;

In a fourth aspect, some embodiments of the present application provide a video call forwarding method, which is applied to an electronic device, and includes:

According to the technical scheme, the embodiments of the application provide a server, electronic equipment and a video call transfer method. After the user inputs the voice command, the electronic equipment detects the command type of the voice command, and the command type is a video call transfer command, and then the voice command is sent to the server. The server detects the source equipment which is executing the video call process, and acquires the target equipment according to the video call transfer instruction. The server sends a data transfer instruction to the source equipment so that the source equipment sends the received video call data to the server; and sending a data acquisition instruction to the target device so that the target device acquires the user data and sends the user data to the server. The server sends the video call data to the target equipment so that the target equipment plays the video call data; and transmitting the user data to the source device so that the source device performs a video call process according to the user data. The user can switch the electronic equipment to carry out video call only by voice control, and the operation is simple and convenient.

Drawings

In order to more clearly illustrate the technical solution of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 illustrates a schematic diagram of a smart home scenario in some embodiments;

FIG. 2 illustrates a block diagram of the hardware configuration of a display device in some embodiments;

FIG. 3 illustrates a schematic diagram of an Internet of things system in some embodiments;

FIG. 4 illustrates a scene diagram of a user voice control electronic device in some embodiments;

FIG. 5 illustrates a schematic diagram of an application panel in some embodiments;

FIG. 6 illustrates a schematic diagram of a video call interface in some embodiments;

FIG. 7 is a diagram illustrating video call forwarding mode confirmation information in some embodiments;

FIG. 8 illustrates a flow diagram of interactions of an electronic device and a server in some embodiments;

FIG. 9 illustrates a schematic diagram of a device control interface in some embodiments;

FIG. 10 illustrates a schematic diagram of a functional interface in some embodiments;

FIG. 11 illustrates a schematic diagram of a master device setup interface in some embodiments;

fig. 12 shows a schematic diagram of an image collector collecting an image of a user in some embodiments.

Detailed Description

For the purposes of making the objects, embodiments and advantages of the present application more apparent, an exemplary embodiment of the present application will be described more fully hereinafter with reference to the accompanying drawings in which exemplary embodiments of the application are shown, it being understood that the exemplary embodiments described are merely some, but not all, of the examples of the application.

Based on the exemplary embodiments described herein, all other embodiments that may be obtained by one of ordinary skill in the art without making any inventive effort are within the scope of the appended claims. Furthermore, while the present disclosure has been described in terms of an exemplary embodiment or embodiments, it should be understood that each aspect of the disclosure can be practiced separately from the other aspects. It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

The smart home system in the embodiment of the present application is a network system based on a specific area network and established based on a unified control service, and the smart home system may include a plurality of electronic devices 200 that establish a communication connection relationship with each other. The plurality of electronic devices 200 may be connected to the same local area network to realize a communication connection relationship between the devices. The plurality of electronic devices 200 may also be directly connected to each other by a point-to-point network formed by a unified communication protocol. For example, the plurality of electronic devices 200 may be connected to the same wireless lan so that the plurality of electronic devices 200 may communicate with each other. For example, one electronic device 200 may also establish communication connection with other electronic devices 200 via bluetooth, infrared, cellular network, power carrier communication, etc.

The electronic device 200 is a device having a communication function, capable of receiving, transmitting, executing control instructions, and realizing a specific function. The electronic device 200 includes, but is not limited to, a smart display device, a smart terminal, a smart appliance, a smart gateway, a smart lighting device, a smart audio device, a gaming device, and the like. The plurality of electronic devices 200 constituting the smart home system may be the same type of device or different types of devices. Fig. 1 illustrates a schematic diagram of a smart home scenario in some embodiments. As shown in fig. 1, in the same smart home system, a smart television, a smart speaker, a smart refrigerator, a plurality of smart lamps, etc. may be included. The electronic devices 200 may be distributed in different locations to meet the usage requirements at the corresponding locations.

It should be noted that, the smart home system of the present application does not limit the application scope of the protection scheme of the present application. That is, in practical application, the server, the electronic device and the multi-device voice wake-up method provided by the application are not limited to be applied to the field of smart home, and are also applicable to other systems supporting smart voice control, such as smart office systems, smart service systems, smart management systems, industrial production systems and the like.

In the smart home system, a user may operate each electronic device 200 through the smart terminal 300 or the control apparatus 100. In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the electronic device 200 includes at least one of infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the electronic device 200 is controlled by a wireless or wired mode. The user may input a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, etc., to control the electronic device 200.

The intelligent terminal 300 can realize the same functions as the control apparatus 100 and support further extended functions and multi-device control on the basis of the corresponding control functions of the control apparatus 100. For example, the intelligent terminal 300 may be a control device such as a mobile phone, a tablet computer, a computer, or the like. The intelligent terminal 300 can be provided with a universal remote controller application, and a user can simulate the function of the control device 100 matched with the electronic equipment 200 after starting the application and selecting the model of the electronic equipment 200 or pairing the electronic equipment 200.

The electronic device 200 has a specific hardware configuration according to the actual function of the electronic device 200. Fig. 2 shows a block diagram of a hardware configuration of a display device in some embodiments. As shown in fig. 2, taking a display device as an example, the electronic device 200 having a display function may include at least one of a modem 210, a communicator 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation interface, and a user manipulation UI interface.

The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; either the detector 230 comprises an image collector, such as a camera, which may be used to collect external environmental scenes, user attributes or user interaction gestures, or the detector 230 comprises a sound collector, such as a microphone or the like, for receiving external sounds.

The device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

The controller includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphic processor (Graphics Processing Unit, GPU), a RAM (Random Access Memory, RAM), a ROM (Read-Only Memory), a first to nth interface for input/output, a communication Bus (Bus), and the like.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Or the user may input the user command by inputting a specific sound or gesture, the user input interface recognizes the sound or gesture through the sensor, and receives the user input command.

In some embodiments, the electronic device 200 is also in data communication with a server 400. Electronic device 200 may be permitted to communicate over a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various content and interactions to the electronic device 200. The server 400 may be a cluster or multiple clusters, and may include one or more server groups.

The electronic device 200 and the server 400 forming the smart home system can communicate with each other, so as to realize comprehensive control of the smart home system. That is, the electronic device 200 may report data to the server 400 in an application, so that the server 400 may analyze, judge, and process based on the data reported by the electronic device 200 to generate a control instruction for the electronic device 200. The server 400 then issues the generated control instruction to the electronic device 200, so as to control the operation state of the electronic device 200.

The plurality of electronic devices 200 in the smart home system may also establish a communication connection relationship with each other. The electronic device 200 may be an IOT (Internet ofThings ) device, and multiple electronic devices 200 together form an internet of things system. Fig. 3 illustrates a schematic diagram of an internet of things system in some embodiments. The internet of things system generates and collects data from different dimensions through the internet of things, and achieves cooperative control on a plurality of electronic devices 200. The plurality of electronic devices 200 can be connected to the same wireless local area network, so that a communication connection relationship is established between the plurality of electronic devices 200, any device can send shared data to an internet of things (IoT) system, and any device can acquire the data shared by other devices through the IoT system, so that collaborative operation in the intelligent home system is realized. The electronic device 200 may also be AIoT (ARTIFICIAL INTELLIGENCE & Internet of Things, artificial intelligence internet of things) devices, and multiple electronic devices 200 may make up the AIoT system.

In some embodiments, to enhance the user's use experience, the electronic device 200 may have intelligent voice control functionality so that the user may voice control the electronic device 200.

The electronic device 200 may incorporate an intelligent voice system to support intelligent voice control of the user. Intelligent voice control refers to an interactive process in which a user operates the electronic device 200 by inputting voice audio data. To implement intelligent voice control, the electronic device 200 may include an audio input device and an audio output device. The audio input device is used for collecting voice audio data input by a user, and may be a sound collector built in or externally connected to the electronic device 200, such as a microphone. The audio output device is used for emitting sound to play the voice response. FIG. 4 illustrates a scene diagram of a user voice control electronic device in some embodiments. As shown in fig. 4, when the user inputs "hi |" through the audio input device! When a wake-up word of little x "or the like, the electronic device 200 may play a voice response of" i am "through the audio output device to guide the user to complete subsequent voice input.

In some embodiments, the intelligent voice system built into the electronic device 200 also supports a one-language direct mode, i.e., a "one-shot" mode. In this mode, the user can directly implement the control function through a small number of voice inputs. For example, in the conventional mode, when the user wants to control the electronic device 200 to play the movie resource, he needs to input the voice "hi, and after the electronic device 200 feeds back" i am "and then inputs" i am about to watch the movie ", the electronic device 200 feeds back" find the movie below for you ". In the "one-shot" mode, the user can directly input "hi-! If the user wants to watch the movie, the electronic device 200 directly feeds back the movie below for you after receiving the voice command, so that the number of voice interaction times is reduced, and the voice interaction efficiency is improved.

In some embodiments, the electronic device 200 may also support some other functions in view of the user's use experience, e.g., the electronic device 200 may have other electronic device control capabilities to control other electronic devices to implement some functions.

For a plurality of electronic devices 200 in the same smart home system, a user can control the linkage of the plurality of devices through smart voice. For example, a user may input a voice command "turn on a bedroom lamp" through the intelligent speaker, and the intelligent speaker may generate a control command for turning on light in response to the voice command, and then send the control command to a lamp named "bedroom" in the smart home system to control the bedroom lamp to be turned on. Meanwhile, the intelligent sound box also responds to voice input of the user, and plays feedback voice contents such as 'turn on a bedroom lamp for you' and the like to reply to the user.

In the coordinated control of the plurality of electronic devices 200, the control instruction may be directly transmitted to the controlled device through the electronic device 200 that receives the voice audio data of the user, or may be transmitted to a specific relay device such as a router through the electronic device 200, and then transmitted to the controlled device through the relay device. In some embodiments, control instructions may also be communicated to the controlled device through the server 400. For example, when the user controls a certain electronic device 200 in the smart home system through the smart terminal 300 outside the local area network where the smart home is located, the smart terminal 300 may send a control instruction to the server 400, and then the server 400 transmits the control instruction to the electronic device 200 to perform control.

For electronic devices of display type, taking the display device as an example, the display device may have various functions, such as browsing web pages, playing media assets, entertainment games, projecting screens, etc., so as to provide various services to users. The user may control the display device to launch a related application program to thereby launch a corresponding function.

In some embodiments, the controller 250 may control the display 260 to display a user interface when the user controls the display device to power on. The user interface may be a specific target image, for example, various media materials obtained from a network signal source, including video, pictures and the like. The user interface may also be some UI interface of the display device, such as a system main interface, various setting interfaces, various control interfaces of the application program, and the like.

An application panel, such as a My application control, may be included in the user interface. The user can view the application installed by the display device, i.e., the functions supported by the display device, through the application panel. It should be noted that, the application installed in the display device may be a system application or a third party application. And the user controls the display device to realize the corresponding function of the application program by starting the application program.

Fig. 5 shows a schematic diagram of an application panel in some embodiments. As shown in fig. 5, the application panel includes several controls, namely "web media", "browser", and "video call". The user can control the display device to watch the network media asset by clicking on the network media asset control. The user may click on the "browser" control to view the web page content using the display device. The user may click on the "video call" control to engage in a video call using the display device.

In some embodiments, a user may utilize a display device to conduct a video call. It should be noted that the video call function is often bound to the user account, and the user may start the video call application and register his own account to log in. The user account may be bound to the user's cell phone number, thereby identifying the user's identity.

If the user has registered an account, the user can directly log in the account. The video call application can have an account number storage function, and after a user logs in an account number, the video call application can store the login state of the account number, so that complicated operation that the user needs to log in again after starting the application every time is not needed.

The video call application may record user data under the current account, such as user information, a list of friends, and the like. The user information includes, but is not limited to, a user name, a user head portrait and the like, and the friend list includes a plurality of friend information associated with the current account. The user may select a buddy from the buddy list to engage in a video call.

When the video call is carried out, the display equipment can display a video call interface, and the current user picture and the friend picture can be simultaneously displayed in the video call interface, so that the user can better confirm the video conditions of the two parties. FIG. 6 illustrates a schematic diagram of a video call interface in some embodiments. As shown in fig. 6, the video call interface includes a first window and a second window. The first window can display the image content of the user, and the second window can display the image content of friends. The first window and the second window may be the same size, thereby allowing the user to better compare the image content of both parties. In consideration of the viewing experience of the user, the size of the second window can be set larger, so that the user can better view the image content of the other party.

In some embodiments, only the image content at the friends may be displayed in the video call interface, without displaying the image content of the user itself. The specific form of the video call interface in the embodiment of the application is not limited.

As the number of electronic devices in a house increases, electronic devices supporting a video call function may be provided in a plurality of rooms. For this reason, the user is not limited to using the same electronic device for video call at a time, but may perform video call in a different electronic device. The user can log in the user account number of the user in the living room television to carry out video call, and can log in the account number in the bedroom television to realize video call. The video call process can be realized by only ensuring that the currently used electronic equipment is logged in with a user account.

It should be noted that, when the user is in the process of video call, there may be a need to switch the electronic device to perform video call for various reasons. For example, a user is currently engaged in a video call using a living room television, but is tired, at which point he wants to go back to a bedroom for rest, but wants to continue the video call process in the bedroom. At this time, the user wishes to continue the video call using the electronic device in the bedroom.

However, limited by the security concerns of user account login, only one electronic device may be able to login to the user account at the same time. When a user account is logged in the living room television, the electronic equipment in the bedroom cannot log in the account. For this reason, if the user wants to make a video call in a bedroom, the user needs to log out of the user account in the living room television first, start the video call application in some electronic device in the bedroom, log in the user account again, and make a video call by using the device. According to the method, when the user switches the electronic equipment to conduct video call each time, the user needs to log in the user account again, and the operation is complicated. Meanwhile, the previous video call process can be disconnected, and when the user performs the operation, the video call can be carried out again, so that the video call process of the user is interrupted, seamless switching can not be achieved, and the use experience of the user is poor.

In order to solve the above problems, the electronic device provided by the embodiment of the present application may have a video call forwarding function. In the embodiment of the application, the electronic equipment is controlled by the server to realize video call transfer. When the user instructs the switching device to perform video call, the server may send related data in the device before switching, for example, images at friends, to the device after switching, so that the device after switching displays the images of the friends. Meanwhile, the server can control the equipment after switching to collect the user image and send the user image to the equipment before switching, so that the equipment before switching executes the video call process according to the user image. Therefore, when the user does not switch the user account, the user can switch other devices to carry out video call, and the operation is simple.

The electronic equipment can be provided with a video call transfer mode so as to start a video call transfer function.

In some embodiments, the user may send a video call transfer mode instruction to the electronic device by operating a designated key of the remote control. And pre-binding the corresponding relation between the video call transfer mode instruction and the remote controller key in the actual application process. For example, a video call transfer mode key is set on the remote controller, when the user touches the key, the remote controller sends a video call transfer mode instruction to the controller, and at this time, the controller controls the electronic device to enter a video call transfer mode so as to start a video call transfer function.

A video call transfer mode option may also be set in the system UI interface of the electronic device 200, and when the user clicks the option, the electronic device 200 may be controlled to enter or exit the video call transfer mode.

In some embodiments, to prevent the user from triggering the video call transfer mode by mistake, when the controller 250 receives the video call transfer mode instruction, the display 260 may be controlled to display the video call transfer mode confirmation information, so that the user performs a secondary confirmation as to whether to control the electronic device 200 to enter the video call transfer mode. Fig. 7 is a schematic diagram of video call transfer mode confirmation information in some embodiments.

FIG. 8 illustrates a flow diagram of interactions of an electronic device and a server in some embodiments. As shown in fig. 8, the server may perform the steps of:

s101, responding to a voice instruction sent by electronic equipment, and detecting source equipment; the instruction type of the voice instruction is a video call transfer instruction;

s102, acquiring target equipment according to the video call transfer instruction;

S103, sending a data transfer instruction to the source equipment so that the source equipment can send the received video call data to the server; and sending a data acquisition instruction to the target equipment so that the target equipment acquires user data and sends the user data to a server; the user data comprises audio and video data transmitted when the video call function is executed;

S104, sending the video call data to the target equipment so that the target equipment plays the video call data; and transmitting the user data to the source equipment so that the source equipment executes a video call process according to the user data.

In some embodiments, a user may use an electronic device to conduct a video call. In the embodiment of the application, the electronic device executing the video call process is called a source device. When the user needs to switch the electronic equipment to perform video call, a video call switching instruction can be input to instruct other electronic equipment to switch the video call process of the source equipment.

In AIOT smart home control business, a user can combine a plurality of electronic devices in the home through cloud service to complete intelligent linkage of multi-device control in the whole home. The server is used as a control center and can analyze various instructions of a user and control each electronic device to realize corresponding functions.

The user may not be able to send the instructions directly to the server, and each electronic device in the smart home may receive the user instructions and forward the user instructions to the server. The server is provided with a communication module, and the electronic equipment is provided with a communicator. The communication module and the communicator can realize communication connection between the server and the electronic equipment.

Communication connection can be established between a plurality of electronic devices through the communicator, so that the electronic devices can be directly connected with each other in a communication mode, and data interaction is achieved.

In order to facilitate the control of the electronic equipment in the whole house by the user, the electronic equipment can display the related information of other electronic equipment which can be controlled currently to the user. When the user instructs to control other electronic devices, the current electronic device may present a device control interface to the user.

The electronic device can acquire device information of other electronic devices in the intelligent home system, including device names and supported functions of the other electronic devices. The electronic device may send a request to the server to obtain device information for other electronic devices. When the intelligent home system is installed, when a new electronic device is connected, the device information of the electronic device can be logged into the server, so that the server can inquire the device information of each electronic device and send the device information to the electronic device. After receiving the information sent by the server, the electronic device can count other electronic device information and generate a device control interface. FIG. 9 illustrates a schematic diagram of a device control interface in some embodiments. As shown in fig. 9, the device control interface includes controls of other electronic devices, where each control represents one electronic device, and the controls may include a second-floor living room television, a first-floor kitchen refrigerator, a secondary-lying sound box, and a first-floor living room television. When the electronic equipment logs in the information to the server, the user can customize the equipment name of the electronic equipment so as to facilitate the subsequent distinction. The user may select the electronic device to be controlled according to the device name in the device control interface.

When a user selects a certain electronic device, the electronic device may display a functional interface of the electronic device. FIG. 10 illustrates a schematic diagram of a functional interface in some embodiments. As shown in fig. 10, when the user selects to control the second floor television, the electronic device may display a functional interface of the second floor television, including functions supported by the second floor television, including playing cable television, playing network media, playing music, turning on/off, and the like. When a user selects one of the functions, the electronic device can send a control instruction for indicating the implementation of the function to the second floor living room television. After receiving the control instruction, the second floor living room television can execute the control instruction to realize corresponding functions.

In some embodiments, the user may directly input voice instructions. The electronic device may collect user speech through the sound collector. The user inputs voice instructions, and the electronic device can respond to the user instructions to realize corresponding functions.

It should be noted that, after the user inputs the voice command, a plurality of electronic devices may receive the user command at the same time, which causes a situation of command confusion. For this purpose, the house may be divided into a plurality of areas, for example, the areas are divided by rooms, and each room is determined as one area including a main sleeping area, a first floor living room, a second floor living room, a secondary sleeping area, and the like. And a main control device is arranged in each area and is used for receiving the voice instruction of the user.

The server can count all the electronic devices in the user's home, and count the electronic devices in each area. When the intelligent home system installs new electronic equipment, the equipment information of the electronic equipment and the area where the equipment is located can be reported to the server, so that the server can determine the area where each electronic equipment belongs. One electronic device may be selected in each area as a master device. The master device may manage other electronic devices in the current area, for example, send various control instructions.

In order to avoid that all the electronic devices respond to the voice command of the user simultaneously to influence the user, the main control device in each area can be set to collect the voice of the user, and other devices do not collect the voice of the user. After analyzing the user voice, the main control device controls other electronic devices to execute the user instruction.

The master device of each zone may be set by the user himself. FIG. 11 illustrates a schematic diagram of a master device setup interface in some embodiments. As shown in fig. 11, the master device setting interface includes area controls corresponding to a plurality of areas in the house. After a user selects a region control, the display may display a plurality of electronic devices in the region. The user may select a device as the master device for the zone. For example, kitchen areas include refrigerators, smokers, monitors, and ovens. The user may select the refrigerator as a master device for the kitchen area.

The server may also select the master device of each first zone, e.g. the server may select the electronic device closest to the centre of the zone as the master device.

In some embodiments, after the user inputs the voice command, the user voice may be collected by the master control device. When the user instructs to control a certain electronic device, the master control device may directly send a user instruction to the device, so that the device responds to the instruction. However, when the user inputs a video call transfer instruction, a plurality of devices need to respond together, and the video call transfer process is controlled and executed by the server. For this purpose, the master device may send the instruction to the server.

To this end, in response to a voice command input by a user, the controller may detect a command type of the voice command. The controller may convert the voice command to voice text and then perform semantic analysis on the voice text to detect the command type.

If the instruction type is a video call transfer instruction, the controller may send a voice instruction to the server. The original voice command, namely voice data, can be directly sent to the server; the recognized phonetic text may also be sent to a server.

The server can receive a video call transfer instruction sent by the electronic equipment so as to execute a video call transfer process. In response to the instruction, the control module of the server may detect a source device currently performing the video call process.

The control module may query the operating state of each electronic device, thereby detecting a source device that performs the video call process. In some embodiments, the control module may also obtain the electronic device currently logged in with the user account, and determine the electronic device as the source device, in consideration of that the source device logs in with the user account to perform the video call process.

In some embodiments, the control module may obtain the target device according to a video call forwarding instruction. In the embodiment of the application, the target device refers to the electronic device for continuing the video call. The image display process and the image acquisition process are performed by the target device, namely, the user views the influence of friends through the target device, and the target device acquires images of the user.

The control module can acquire the target equipment according to the indication information of the user in the video call transfer instruction.

The control module can perform semantic analysis on the video call transfer instruction to acquire keyword information. The video call transfer instruction includes a control intention of the user, and may include the following intents: specific content to be executed by which device, in which region, and executed. After semantic analysis of the video call transfer instruction, a plurality of keywords can be obtained. For example, if the user instruction is "transfer video call on refrigerator screen", the intention may be analyzed as: and executing by the refrigerator, and executing the video call transfer process. Keywords may be obtained as: refrigerator, video call transfer.

The information contained in the video call forwarding instruction is ambiguous in that the target device may be directly indicated. For this purpose, the control module may first detect whether the keyword information includes a device name.

If the keyword information contains the device name, the user explicitly indicates the target device, and the control module can directly set the electronic device corresponding to the device name as the target device.

In some embodiments, if the user explicitly indicates the target device, that is, the keyword information includes the device name, after determining the target device, the control module may further detect whether the target device has the video call capability, so as to ensure that the target device can implement a process of transferring the video call.

Basic conditions of video call need to be supported by input and output equipment, namely a microphone and a camera, and the input equipment can collect audio and video information of a user; the output device, namely a loudspeaker and a display, can display the audio and video information of the other party of the call. The video call capability can be summarized as several data processing capabilities including: sound collection capability, image collection capability, audio playback capability, and video display capability. The electronic device needs to have several of the above capabilities to be able to transfer the video call.

If the target device does not have the capability, the video call cannot be transferred. At this time, the server may transmit a prompt message to the main control device, and the main control device informs the user of the situation to replace the target device. For example, when the target device is a refrigerator, the prompt may be to ask the user "the refrigerator device does not have a screen play capability, please select other devices". The user may reenter the video call forwarding instruction to instruct other target devices.

If the target device has video call capability, the server can cause the master device to voice prompt the user that the video call has been transferred to the refrigerator device for you.

In some embodiments, if the keyword information does not include a device name, it is indicated that the user does not explicitly indicate the target device, and the control module needs further analysis to determine the target device. The controller may obtain a video call forwarding area and screen the target device in the video call forwarding area. In the embodiment of the application, the video call transfer area refers to an area where the transfer video call process is located.

The video call forwarding instruction may indicate that there is intended content of the video call forwarding area. For example, the video call transfer instruction is "transfer video call in kitchen", and indicates that the video call transfer area is a "kitchen" area.

For this purpose, the control module may detect whether the keyword information includes a region name.

If the keyword information contains the area name, indicating that the user indicates a video call transfer area, and the control module can set the area corresponding to the area name as the video call transfer area;

If the keyword information does not contain the area name, the user is not indicated to the video call transfer area, and the control module can acquire the area equipment information by itself.

The control module may obtain the regional device information. The area device information includes a plurality of areas and electronic device information in the areas. The control module may determine the electronic device status included in each zone through the zone device information.

The control module can detect a target area corresponding to the electronic device sending the video call transfer instruction, and set the target area as the video call transfer area. For example, a user inputs a video call forwarding instruction in a kitchen area, a main control device of the kitchen area may collect the user instruction and send the user instruction to a server, and the server may set the kitchen area as the video call forwarding area.

In some embodiments, after determining the video call forwarding area, the control module may screen the target device in the video call forwarding area.

The video call forwarding area may include a plurality of electronic devices, and the control module may acquire device information of the plurality of electronic devices in the video call forwarding area. The device information includes capability information supported by the electronic device.

The control module may detect video call capabilities of the plurality of electronic devices based on the device information and set the electronic device having the video call capabilities as the target device.

In some embodiments, after determining the target device, the server controls the source device and the target device to cooperatively implement a video call transfer process.

The control module sends a data transfer instruction to the source device so that the source device can send the received video call data to the server. And the control module sends a data acquisition instruction to the target device so that the target device acquires user data and sends the user data to the server. The video call data is data sent to the source equipment by the other party of the call, and comprises user images and voice collected by the other party.

When the video call process is independently performed, the source device collects user data and plays the video call data.

When the video call transfer process is cooperatively implemented, the source device may not perform the collection of user data and the playing of video call data, but the target device performs both operations.

In some embodiments, the electronic device is provided with a display, a sound collector, an image collector and an audio device for displaying images, collecting user speech, collecting user images and playing audio, respectively.

The display is fixedly arranged inside the electronic equipment, the sound collector, the image collector and the audio equipment can be arranged in the electronic equipment, and the display can be externally connected to the electronic equipment through the device interface.

Taking an image collector as an example, the image collector can support a lifting function. The camera can be arranged on the lifting mechanism, and when image acquisition is needed, the lifting mechanism is controlled to move through a specific lifting instruction, so that the camera is driven to rise, and the image acquisition is carried out. When image acquisition is not needed, the lifting mechanism can be controlled to move through a specific lifting instruction, so that the camera is driven to be lowered, and the camera is hidden.

For an external image collector, the electronic equipment can be connected through a specific data interface. Fig. 12 shows a schematic diagram of an image collector collecting an image of a user in some embodiments. As shown in fig. 12, the controller may control the image collector to collect the user image and transmit the user image to the electronic device.

In response to the data acquisition instructions sent by the server, the target device may acquire user data and send the user data to the server, so that the server sends the user data to the source device, where the user data is used to cause the source device to perform a video call process.

The controller may control the sound collector to collect user voice data and the image collector to collect user image data. The controller may generate the user data from the user voice data and the user image data.

Accordingly, the user data includes audio-video data transmitted while the video call function is performed.

In some embodiments, the server may receive video call data sent by the source device, as well as user data sent by the target device.

The control module may send the video call data to the target device to cause the target device to play the video call data. And transmitting the user data to the source device so that the source device performs a video call process according to the user data.

After receiving the video call data sent by the server, the target device can play the video call data. The controller may perform decoding on the video call data to obtain video data and audio data. The controller may control the display to display video data and the audio device to play audio data.

After receiving the user data sent by the server, the source device can continue to execute the video call process with the other party device so as to ensure the stability of the video call link, thereby normally executing the video call process.

In the embodiment of the application, a direct seamless transition mode is used, and the log-out process of the user account is not involved, namely the source equipment does not need to log out the account, and other equipment does not need to log in the user account. The communication center is always a source device, and the server is used as a control center to realize the transfer process of the video call. The user does not need other operations, only needs voice control, is simple and convenient to operate, and greatly improves the use experience of the user.

In some embodiments, the server may not have the electronic device alone transfer the video call process after determining the video call transfer area. For example, none of the plurality of electronic devices in the video call forwarding area have video call capability, or the video call capable electronic device fails to perform the process.

At this time, the server may control the plurality of electronic devices to cooperatively perform a process of transferring the video call. Capability complementarity among different devices can be fully utilized, and the whole call transfer process is cooperatively realized. For example, each device in a kitchen does not have all the capability of video call, but the oven can perform audio collection and audio playing, the smoke machine screen can perform video playing, the monitoring can perform video collection, and the three devices can operate simultaneously to cooperatively complete the whole video call process.

If none of the plurality of electronic devices has video call capability, the control module may obtain data processing capabilities of the plurality of electronic devices based on the device information. The data processing capability includes sound collection capability, image collection capability, audio playing capability and video display capability.

Taking the kitchen area as an example, table 1 is capability information of a plurality of electronic devices.

Table 1 electronic device capability information

Kitchen appliance	Refrigerator with a refrigerator body	Smoke machine	Oven with a baking oven	Monitor controller
					Sound collection	Support for	Support for	Support for	Not support
Audio playing	Support for	Support for	Support for	Not support
					Image acquisition	Support for	Not support	Not support	Support for
Video display	Support for	Support for	Not support	Not support
					Self video call	Support for	Not support	Not support	Not support

The kitchen area includes four electronic devices: refrigerator, cigarette machine, oven and monitor. Wherein only the refrigerator supports the video call capability, but the refrigerator may malfunction to perform no video call process, such as image acquisition capability and sound acquisition capability failure. I.e. no device capable of video call transfer alone at this time.

The control module may detect a data processing capability condition of each device. Wherein, the cigarette machine supports 3 kinds of ability, and the oven supports 2 kinds of ability, and the monitor supports 1 kind of ability. If there is a device that has failed, the device is considered to be in a non-equipped state in terms of its ability to fail when the data processing ability of the device is counted. For example, if the image acquisition capability and the sound acquisition capability of the refrigerator fail, the refrigerator is considered to support 2 capabilities.

The control module may screen the first device with the most data processing capability, and detect the capability that the first device does not have, which is referred to as the remaining data processing capability in the embodiment of the present application. Taking the above as an example, the range hood supports a maximum of 3 capabilities, so the range hood is the first device. Meanwhile, the unsupported capability of the smoke machine, namely the residual data processing capability is the image acquisition capability.

It should be noted that if there are a plurality of devices supporting the same amount of data processing capability, one device may be selected randomly as the first device.

The control module may screen the second device for remaining data processing capabilities. For example, when the remaining data processing capability is an image capturing capability, other devices supporting the capability may be screened, and the monitor may be set as the second device.

The control module may set the first device and the second device as target devices. The first device and the second device can cooperatively realize the transfer process of the video call. For example, the range hood is a first device supporting 3 capabilities of sound collection, audio playback and video display; the monitor is a second device supporting image acquisition capabilities. At this time, the smoke machine can be enabled to collect user voice, display video data sent by the source equipment and play audio data sent by the source equipment. And enabling the monitor to collect the user image. The first device and the second device can cooperate to realize the transfer of the video call.

If the first device and the second device have the same capabilities, the first device is preferred. I.e. the first device performs the procedure corresponding to all the capabilities it supports, and the procedure corresponding to the remaining data processing capabilities is performed by the second device.

In some embodiments, the user may have a need to share a video call. For example, there are user a and user B in the house. A friend in a foreign country plays a video call, hopefully communicating with both user a and user B. However, at this time, the user a is watching television in the living room, the user B is resting in the bedroom, and two persons are not in one area, and cannot use one electronic device. At this time, two persons can share the video call, namely, the user A utilizes the living room television, the user B utilizes the bedroom equipment to jointly conduct the video call with friends, so that the friends can see images of the user A and the user B at the same time, and meanwhile, video contents of the friends can be shared in equipment corresponding to the two users.

In response to the video call sharing instruction, the control module may send a data acquisition instruction to the source device to cause the source device to acquire and send shared user data to the server. At this time, the source device and the target device both collect data and send the data to the server, where the data collected by the source device is referred to as shared user data, and the data collected by the target device is referred to as user data.

The control module can generate video call sharing data according to the sharing user data and the user data collected by the target equipment, wherein the video call sharing data is fused with the data collected by the two equipment, namely, the data of a plurality of users are fused to form a multi-user image.

The control module can send the video call sharing data to the source equipment so that the source equipment executes a video call process according to the video call sharing data; and sending a video playing instruction to the source equipment so that the source equipment plays the video call data. Therefore, the other party of the call can receive the video call sharing data sent by the source equipment, so that the image of multiple users can be seen. Meanwhile, the source equipment and the target equipment can display the image of the other party of the call, and the shared video call is realized.

In some embodiments, the source device and the target device are performing a video call transfer procedure, and if the user instructs the source device to shut down, the source device disconnects the video call. Because the source device logs in with the user account, but the target device does not log in with the user account, the target device cannot perform video call. Therefore, after the user inputs a shutdown instruction to the source device, the server can detect whether a video call transfer process exists.

In response to a source device shutdown instruction, the control module may detect a source device state and a target device state.

If the source equipment is in the video call state and the target equipment is in the video call data playing state, the control module can control the source equipment to exit the user account and control the target equipment to log in the user account.

The control module can control the target equipment to execute the video call process and control the source equipment to be powered off. At this time, the target device can perform the video call alone without affecting the use of the user.

The embodiment of the application also provides a video call transfer method which is applied to the server and comprises the following steps:

step 101, responding to a voice instruction sent by electronic equipment, and detecting source equipment; the instruction type of the voice instruction is a video call transfer instruction;

102, acquiring target equipment according to a video call transfer instruction;

Step 103, sending a data transfer instruction to the source equipment so that the source equipment sends the received video call data to the server; transmitting a data acquisition instruction to the target equipment so that the target equipment acquires user data and transmits the user data to the server; the user data includes audio and video data transmitted when the video call function is performed;

104, sending the video call data to the target equipment so as to enable the target equipment to play the video call data; and transmitting the user data to the source device so that the source device performs a video call process according to the user data.

In some embodiments, the method further includes the step of obtaining the target device according to the video call forwarding instruction:

And carrying out semantic analysis on the video call transfer instruction to acquire keyword information. And if the keyword information contains the device name, setting the electronic device corresponding to the device name as the target device. And if the keyword information does not contain the equipment name, acquiring a video call transfer area, and screening target equipment in the video call transfer area.

In some embodiments, obtaining a video call forwarding area further includes:

And if the keyword information contains the area name, setting the area corresponding to the area name as a video call transfer area.

And if the keyword information does not contain the area name, acquiring area equipment information, wherein the area equipment information comprises a plurality of areas and electronic equipment information in the areas. And detecting a target area corresponding to the electronic equipment sending the video call transfer instruction, and setting the target area as the video call transfer area.

In some embodiments, selecting a target device in the video call forwarding area further comprises:

And acquiring the equipment information of the plurality of electronic equipment in the video call transfer area. Video call capabilities of the plurality of electronic devices are detected based on the device information, and the electronic device having the video call capabilities is set as a target device.

If the plurality of electronic devices do not have the video call capability, acquiring the data processing capability of the plurality of electronic devices based on the device information; the data processing capabilities include sound collection capabilities, image collection capabilities, audio playback capabilities, and video display capabilities. Screening out the first equipment with the highest data processing capacity, and detecting the residual data processing capacity which the first equipment does not have. And screening out the second equipment with the residual data processing capability. The first device and the second device are set as target devices.

In some embodiments, further comprising:

and responding to the video call sharing instruction, and sending a data acquisition instruction to the source equipment so that the source equipment acquires the sharing user data and sends the sharing user data to the server. And generating video call sharing data according to the sharing user data and the user data acquired by the target equipment. Transmitting the video call sharing data to the source equipment so that the source equipment executes a video call process according to the video call sharing data; and sending a video playing instruction to the source equipment so that the source equipment plays the video call data.

In some embodiments, the source device has a user account logged in.

And detecting the source device state and the target device state in response to a source device shutdown instruction. And if the source equipment is in the video call state and the target equipment is in the video call data playing state, controlling the source equipment to exit the user account and controlling the target equipment to log in the user account. And controlling the target equipment to execute the video call process and controlling the source equipment to be powered off.

The embodiment of the application also provides a video call transfer method which is applied to the electronic equipment and comprises the following steps:

If the instruction type is a video call transfer instruction, sending a voice instruction to a server;

Responding to a data acquisition instruction sent by the server, acquiring user data and sending the user data to the server so that the server can send the user data to the source equipment, wherein the user data comprises audio and video data transmitted when a video call function is executed;

And receiving the video call data sent by the server and playing the video call data, wherein the video call data is sent to the server by the source equipment.

In some embodiments, the device interface connects the image collector and the audio apparatus.

The sound collector is controlled to collect user voice data, and the image collector is controlled to collect user image data. User data is generated from the user speech data and the user image data.

Decoding is performed on the video call data to obtain video data and audio data. The control display displays the video data and controls the audio device to play the audio data.

The same and similar parts of the embodiments in this specification are referred to each other, and are not described herein.

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied essentially or in parts contributing to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method of the embodiments or some parts of the embodiments of the present invention.

Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present application, and not for limiting the same; although the application has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the application.

The foregoing description, for purposes of explanation, has been presented in conjunction with specific embodiments. The illustrative discussions above are not intended to be exhaustive or to limit the embodiments to the precise forms disclosed above. Many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles and the practical application, to thereby enable others skilled in the art to best utilize the embodiments and various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A server, comprising:

a communication module configured to establish a communication connection with an electronic device;

a control module configured to:

Acquiring target equipment according to the video call transfer instruction;

2. The server of claim 1, wherein the control module executing the obtaining the target device according to the video call forwarding instruction is further configured to:

Carrying out semantic analysis on the video call transfer instruction to obtain keyword information;

If the keyword information contains the equipment name, setting the electronic equipment corresponding to the equipment name as target equipment;

And if the keyword information does not contain the equipment name, acquiring a video call transfer area, and screening target equipment in the video call transfer area.

3. The server of claim 2, wherein the control module executing the acquiring video call forwarding area is further configured to:

if the keyword information contains a region name, setting a region corresponding to the region name as a video call transfer region;

If the keyword information does not contain the area name, acquiring area equipment information, wherein the area equipment information comprises a plurality of areas and electronic equipment information in the areas; and detecting a target area corresponding to the electronic equipment sending the video call transfer instruction, and setting the target area as a video call transfer area.

4. The server of claim 2, wherein the control module performs screening for target devices in the video call forwarding area, further configured to:

Acquiring equipment information of a plurality of electronic equipment in the video call transfer area;

Detecting video call capabilities of a plurality of electronic devices based on the device information, and setting the electronic device with the video call capabilities as a target device;

if the plurality of electronic devices do not have video call capability, acquiring the data processing capability of the plurality of electronic devices based on the device information; the data processing capability comprises sound acquisition capability, image acquisition capability, audio playing capability and video display capability;

screening out a first device with the most data processing capacity, and detecting the residual data processing capacity which the first device does not have;

Screening out a second device with the residual data processing capability;

Setting the first device and the second device as target devices.

5. The server of claim 1, wherein the control module is further configured to:

responding to the video call sharing instruction, and sending a data acquisition instruction to the source equipment so that the source equipment acquires the sharing user data and sends the sharing user data to the server;

Generating video call sharing data according to the sharing user data and the user data collected by the target equipment;

Transmitting the video call sharing data to source equipment so that the source equipment executes a video call process according to the video call sharing data; and sending a video playing instruction to the source equipment so that the source equipment plays the video call data.

6. The server of claim 1, wherein the source device has a user account logged in, the control module further configured to:

responding to a source equipment shutdown instruction, and detecting a source equipment state and a target equipment state;

If the source equipment is in a video call state and the target equipment is in a video call data playing state, controlling the source equipment to exit the user account and controlling the target equipment to log in the user account;

and controlling the target equipment to execute the video call process and controlling the source equipment to be powered off.

7. An electronic device, comprising:

A display;

A communicator configured to establish a communication connection with a server;

a device interface configured to connect to a sound collector for collecting user speech;

A controller configured to:

8. The electronic device of claim 7, wherein the apparatus interface is further configured to connect an image collector and an audio device;

The controller performs the collecting of user data, and is further configured to:

Controlling the sound collector to collect user voice data and controlling the image collector to collect user image data;

generating user data according to the user voice data and the user image data;

the controller performs playing the video call data, and is further configured to:

Decoding the video call data to obtain video data and audio data;

And controlling a display to display the video data and controlling the audio equipment to play the audio data.

9. A video call forwarding method applied to a server, the method comprising:

Acquiring target equipment according to the video call transfer instruction;

10. A video call forwarding method applied to an electronic device, the method comprising: