CN120034524A

CN120034524A - Method for displaying conference data, conference system and computing device

Info

Publication number: CN120034524A
Application number: CN202410153104.XA
Authority: CN
Inventors: 宋琦
Original assignee: Huawei Cloud Computing Technologies Co Ltd
Current assignee: Huawei Cloud Computing Technologies Co Ltd
Priority date: 2023-11-21
Filing date: 2024-02-02
Publication date: 2025-05-23
Also published as: WO2025107624A1

Abstract

The embodiment of the present application discloses a method for displaying conference data, a conference system, and a computing device, and belongs to the field of cloud computing technology. The method is applied to a conference system, and the conference system includes a conference terminal and a cloud platform running a conference management service. The method includes: the conference terminal obtains the attendance status of the first participant in the online conference. In response to the first participant's attendance status being temporarily away, the conference terminal sends a first temporary away status notification to the conference management service. After receiving the first temporary away status notification, the conference management service performs management operations on the conference data in the online conference. In response to the first participant's attendance status changing from temporarily away to listening, the conference terminal displays the conference data corresponding to the management operation through the conference data playback window. By adopting this application, participants can avoid missing the content of the online conference.

Description

Method for displaying conference data, conference system and computing device

The present application claims priority from chinese patent application number 202311563628.8 entitled "a conference system set leave status and interaction method and apparatus" filed on day 21 11 and 2023, the entire contents of which are incorporated herein by reference.

Technical Field

The present application relates to the field of cloud computing technologies, and in particular, to a method for displaying conference data, a conference system, and a computing device.

Background

With the development of internet technology and cloud computing technology, online conferences are also becoming more and more widely used.

During the course of participating in an online meeting, participants may leave the online meeting halfway for various reasons. For example, participants need to make calls during a meeting. But a participant that is halfway out of an online meeting may miss some important content in the online meeting.

Disclosure of Invention

The embodiment of the application provides a method for displaying conference data, a conference system and a computing device, which can prevent participants from missing the content of an online conference, and the corresponding technical scheme is as follows:

In a first aspect, a method of presenting conference data is provided, the method being applied to a conference system. The conference system comprises a cloud platform and a conference terminal, wherein the cloud platform comprises conference management services, and the conference system comprises:

The conference terminal acquires a conference state of a first participant corresponding to the conference terminal in an online conference, wherein the conference state comprises a listening state or a temporary-away state. And the conference terminal responds to the conference state of the first participant as the temporary-away state, and sends a first temporary-away state notification to the conference management service. The conference management service performs a management operation on conference data in the online conference after receiving the first suspension state notification. And the conference terminal responds to the conference state of the first conference participant and changes from the temporary state to the listening state, and the conference data corresponding to the management operation is displayed through the conference data playback window.

In the scheme shown in the application, the conference terminal can identify the conference state of the first conference participant using the conference terminal to participate in the online conference. When the conference terminal determines that the first participant is in a temporary-away state, the conference management service can be notified to manage conference data when the first participant is in the temporary-away state. And then when the conference terminal determines to restore the online state, the conference terminal can display conference data corresponding to the management operation through a conference data playback window. Thus, the first participant can watch the conference content in the temporary-away state, and does not miss important content in the online conference.

In one implementation manner, the method further comprises the step that in the process that the conference state of the first conference participant is in the temporary-away state, the conference management service responds to the fact that the identity information of the first conference participant is detected in the audio data of other conference participants in the online conference, and sends prompt information to conference terminals corresponding to the other conference participants, wherein the prompt information is used for indicating that the first conference participant is in the temporary-away state.

In the scheme shown in the application, the conference management service can identify whether the audio data of other participants in the online conference comprises the identity information of the primary participant when the primary participant is in a temporary-away state. The identity information of the first participant may be a name, a job name, a name used by the first participant to participate in an online conference, and the like of the first participant. If the conference management service identifies the identity information of the first participant in the audio data of the other participants, prompt information can be sent to the conference terminals corresponding to the other corresponding participants to prompt the other participants that the first participant is in a temporary-away state. Therefore, when the first participant is in a temporary-away state, other participants can be prevented from communicating with the first participant, invalid communication in the online conference can be avoided, and the communication efficiency of the online conference of the participants can be improved.

In one implementation manner, the method further comprises that in the process that the conference state of the first participant is in the temporary-away state, the conference management service responds to receiving interaction operation of other participants and the first participant, and sends prompt information to conference terminals corresponding to the other participants, wherein the prompt information is used for indicating that the first participant is in the temporary-away state.

In the scheme shown in the application, the conference management service can detect whether other participants perform interactive operation with the first participant when the first participant is in a temporary-away state, such as '@first participant'. If the conference management service detects that other conferees and the first conferee perform interactive operation, prompt information can be sent to the conference terminals corresponding to the other corresponding conferees so as to prompt the other conferees that the first conferee is in a temporary-away state. Therefore, when the first participant is in a temporary-away state, other participants can be prevented from communicating with the first participant, invalid communication in the online conference can be avoided, and the communication efficiency of the online conference of the participants can be improved.

In one implementation, the conference terminal obtains a conference state of a first participant corresponding to the conference terminal in an online conference, including obtaining a picture of the first participant photographed by the conference terminal according to a detection period. After each time the picture of the first participant is acquired, whether the face image of the first participant exists or not is detected on the picture of the first participant. And determining that the conference state of the first participant is a temporary-away state in response to the fact that the continuous times of the face images of the first participant are not detected to exceed a time threshold.

In one implementation, determining that the conference state of the primary participant is a suspended state in response to the number of consecutive times of the face image of the primary participant not being detected exceeding a number of times threshold includes determining that the conference state of the primary participant is a suspended state in response to the number of consecutive times of the face image of the primary participant not being detected exceeding a number of times threshold and operation information of the conference terminal not being detected within a specified duration.

In the scheme shown in the application, the conference terminal can combine the times of not detecting the face image of the first participant and the duration of not operating the conference terminal by the first participant to accurately determine whether the conference state of the first participant is a temporary state.

In one implementation, performing a management operation on meeting data in an online meeting includes a meeting management service sending a meeting data store notification to meeting terminals. The conference terminal stores video data and audio data of the currently received online conference in response to receiving the conference data storage notification.

In the scheme shown in the application, the management operation for the conference data can be that the conference terminal stores the conference data when the first conference participant is in a temporary-away state. Therefore, after the first participant is restored to the listening state, the conference terminal can play the stored conference data, and further, the first participant can be prevented from missing important conference contents.

In one implementation, the above-mentioned managing operation for conference data in the online conference includes that the conference management service obtains audio data of other participants in the online conference, and converts the obtained audio data of each participant into text data. And the conference management service sends the obtained text data corresponding to each participant to the conference terminal. The conference terminal receives and stores text data corresponding to each conference participant.

In the scheme shown in the application, the conference management operation for conference data can be that when the conference management service is in a temporary-away state for the first conference participant, the audio data of other conference participants are converted into text data, and the text data is sent to the conference terminal for storage. Therefore, after the first participant resumes to the listening state, the participant terminal can display the stored text data, and further the first participant can be prevented from missing important conference contents.

In an implementation manner, the method further comprises the step that after receiving the first temporary-away state notification, the conference management service sends a second temporary-away state notification to conference terminals corresponding to other conference participants in the online conference, wherein the second temporary-away state notification is used for indicating the conference terminals corresponding to the other conference participants to add temporary-away identifiers in display windows corresponding to the first conference participants. Therefore, the first participant can be reminded to other participants to be in a temporary-away state, invalid communication between the other participants and the first participant in the online conference can be avoided, and further communication efficiency of the participants in the online conference can be improved.

In one implementation, the method further includes displaying a cancel-suspension-state control in an online conference interface of the conference terminal in response to the conference state of the first participant being a suspension state. And in response to clicking operation of the release state control, determining that the conference state of the first conference participant is updated from the release state to the listening state.

In a second aspect, a conference system is provided, the conference system including a cloud platform and a conference terminal, the cloud platform including a conference management service, wherein:

And the conference terminal is used for acquiring the conference state of the first conference participant corresponding to the conference terminal in the online conference, wherein the conference state comprises a listening state or a temporary separation state.

And the conference terminal is used for responding to the conference state of the first conference participant as the temporary-away state and sending a first temporary-away state notification to the conference management service.

And the conference management service is used for executing management operation on conference data in the online conference after receiving the first temporary-away state notification.

And the conference terminal is used for responding to the conference state of the first conference participant and changing from the temporary state to the listening state, and displaying conference data corresponding to the management operation through the conference data playback window.

In one implementation manner, in a process that a meeting state of a first meeting participant is in a temporary-away state, the meeting management service is used for responding to detection of identity information of the first meeting participant in audio data of other meeting participants in an online meeting, sending prompt information to meeting terminals corresponding to the other meeting participants, wherein the prompt information is used for indicating that the first meeting participant is in the temporary-away state.

In one implementation manner, in a process that the conference state of the first participant is in a temporary-away state, the conference management service is configured to send, in response to receiving an interaction operation between the other participants and the first participant, a prompt message to a conference terminal corresponding to the other participants, where the prompt message is used to indicate that the first participant is in the temporary-away state.

In one implementation, the conference terminal is configured to acquire a picture of a first participant captured by the conference terminal according to a detection period, detect whether a face image of the first participant exists on the picture of the first participant after each picture of the first participant is acquired, and determine that a conference state of the first participant is a pause state in response to a number of times that a number of consecutive face images of the first participant is not detected exceeding a number of times threshold.

In one implementation manner, the conference terminal is configured to determine that the conference state of the first participant is a temporary-away state in response to the number of times the continuous face image of the first participant is not detected exceeding the number of times threshold, and operation information of the conference terminal is not detected within a specified duration.

In one implementation, a conference management service is used to send conference data store notifications to conference terminals. The conference terminal stores video data and audio data of the currently received online conference in response to receiving the conference data storage notification.

In one implementation, the conference management service is configured to obtain audio data of other participants in the online conference, and convert the obtained audio data of each participant into text data. The conference management service is used for sending the obtained text data corresponding to each participant to the conference terminal. The conference terminal is used for receiving and storing text data corresponding to each conference participant.

In one implementation manner, the conference management service is configured to send a second suspension state notification to a conference terminal corresponding to another conference participant in the online conference after receiving the first suspension state notification, where the second suspension state notification is configured to instruct the conference terminal corresponding to the other conference participant to add a suspension identifier in a display window corresponding to the first conference participant.

In one implementation, the conference terminal is configured to display a cancel-suspend state control in an online conference interface of the conference terminal in response to a conference state of the first participant being a suspend state, and determine that the conference state of the first participant is updated from the suspend state to a listening state in response to a click operation of the cancel-suspend state control.

In a third aspect, a cluster of computing devices is provided, the cluster of computing devices including at least one computing device, each computing device including a processor and a memory. The processor of the at least one computing device is configured to execute instructions stored in the memory of the at least one computing device to cause the cluster of computing devices to perform the method as described in the first aspect above.

In a fourth aspect, there is provided a computer program product comprising instructions which, when executed by a cluster of computing devices, cause the cluster of computing devices to perform the method as described in the first aspect above.

In a fifth aspect, a computer readable storage medium is provided, comprising computer program instructions which, when executed by a cluster of computing devices, perform the method according to the first aspect described above.

Drawings

Fig. 1 is a flowchart of a method for displaying conference data according to an embodiment of the present application;

fig. 2 is an interface schematic diagram of an online conference according to an embodiment of the present application;

fig. 3 is an interface schematic diagram of an online conference according to an embodiment of the present application;

fig. 4 is a flowchart of a method for displaying conference data according to an embodiment of the present application;

fig. 5 is a schematic diagram of a conference system according to an embodiment of the present application;

FIG. 6 is a schematic diagram of a computing device according to an embodiment of the present application;

FIG. 7 is a schematic diagram of a computing device cluster according to an embodiment of the present application;

Fig. 8 is a schematic structural diagram of a computing device cluster according to an embodiment of the present application.

Detailed Description

For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the embodiments of the present application will be described in further detail with reference to the accompanying drawings.

An online conference is a call mode in which multiple people communicate with each other in voice on the line through an online conference application. Conference calls are increasingly being used in life and work because they are not limited by time, place, etc.

In one example, a user may log into his or her account at an online conferencing application running at the terminal, and may then operate at the online conferencing application, creating or joining an online conference in the online conferencing application. When a user creates a conference in an online conference application, the online conference application may send a conference creation request to the cloud platform through the terminal. After receiving the conference creation request sent by the terminal, the conference management service of the cloud platform may create an online conference in the cloud platform and generate a conference identifier (Identity document, ID) of the conference, and then send the conference ID to the terminal. The user may forward the conference ID to other users who need to join the conference call. Other users can operate the online conference application, input the received conference ID in the online conference application, and then join the corresponding online conference. In an example, each user joining the online meeting may be referred to as a meeting participant, and the person creating the online meeting may also be referred to as a meeting host.

After the conference participants join in the conference call through the online conference application running by the terminal, the conference participants can operate the online conference application to open the microphone authority of the terminal, the audio of the conference participants is transmitted to the conference management service through the microphone, and then the collected audio is transmitted to the conference management service through the terminal. In the process of conference call, for the conference participants joining in the conference call, the terminal can receive and play the audio of other conference participants sent by the conference management service, so that a plurality of conference participants can perform conference call on line.

Unlike an off-line conference, when a participant is participating in the on-line conference, the participant may need to leave the on-line conference halfway for various reasons and cannot always watch and listen to conference contents of the on-line conference, so that some important contents in the on-line conference may be missed. For example, in the process that a participant takes part in an online conference through a mobile phone, a call is suddenly made, the participant needs to answer the call, and the participant misses part of online conference content. In addition, other participants cannot obtain whether the participant always views and listens to the online conference content, and other participants may communicate with the participant during the period that the participant is temporarily online. However, the participant does not listen to the content of the online conference temporarily, so that the participant cannot respond to other participants, and the communication efficiency of the online conference is poor.

The embodiment of the application provides a method for displaying conference data, which can identify the temporary-away state of a participant in the online conference process, namely, identify the state that the participant does not watch and listen to online conference content, automatically record the conference content of the participant in the online conference in the temporary-away state, and also can inform other participants in the temporary-away state. Therefore, the online conference content can be prevented from being missed by the participants, and the communication efficiency between the participants in the online conference can be improved.

Fig. 1 is a flowchart of a method for displaying conference data, which is provided by an embodiment of the present application, and the method may be applied to a conference system including a cloud platform and a conference terminal, where a conference management service is running in the cloud platform. The method for displaying conference data is applied to a process of conference participants referring to online conference, and referring to fig. 1, the method comprises the following steps:

Step 101, a conference terminal obtains a conference state of a first participant corresponding to the conference terminal in an online conference, wherein the conference state comprises a listening state or a temporary-away state.

Wherein the primary participant may be any participant in an online conference. The conferencing terminal may run an online conferencing application and the primary participant may operate the online conferencing application in the conferencing terminal to participate in an online conference. The conference participant is in a listening state, that is, the conference participant is in a state of watching and listening to online conference content, and the conference participant is in a temporarily away state, that is, the conference participant is in a state of not watching and listening to online conference content. The conference state of the first participant acquired by the conference terminal can be actively set by the first participant, or can be obtained by detecting the conference state of the first participant by the conference terminal according to a detection period.

Under the condition that the first conferee actively sets the conference state, each conferee defaults to a listening state in the online conference, and a temporary-away state switching control can be set in the online conference application. When the first participant needs to pause the online meeting, the pause state switching control can be clicked to change the first participant from the listening state to the pause state.

Under the condition that the conference terminal detects the conference state of the first participant according to the detection period, the conference terminal can acquire the picture of the first participant shot by the conference terminal according to the period, and detect whether the face image of the first participant exists on the picture of the first participant. And determining that the conference state of the conference participant is a temporary-away state in response to the fact that the continuous times of the face images of the first conference participant are not detected to exceed a time threshold.

In an implementation, in the process that the first participant is participating in the online conference, the conference terminal may capture the picture of the first participant according to the detection period, for example, may capture the picture of the first participant through a front camera of the mobile phone, or capture the picture of the first participant through a camera connected with the host computer. After each shot picture of the primary participant, the participant terminal can detect whether the face image of the primary participant exists in the picture. If a face image of the primary participant is detected in the photographed picture, it may be explained that the primary participant is watching and listening to conference contents of an online conference. If the number of times that the face images of the first participant are not detected continuously in the shot picture exceeds the set number threshold, the first participant can be considered to be not watching and listening to the conference content of the online conference, and the first participant and the participant can be determined to be in a temporary-away state. The first participant may be stored in the conference terminal in advance, for example, after the first participant joins an online conference through the conference terminal, the conference management service may send a face image of the first participant to the conference terminal. The duration and the number of times threshold of the detection period may be preset by a technician, for example, the detection period is 10 seconds, and the number of times threshold is 2.

In another example, the conference terminal may determine the conference status of the primary participant in combination with the operation information of the conference terminal, in addition to determining the conference status of the primary participant by detecting the face image of the primary participant. And after determining that the number of times of continuous face images of the first participant is not detected exceeds a time threshold and operation information of the participant terminal is not detected within a specified time period, determining that the participant state of the participant is a temporary state.

The operation information may be an operation time of the first participant in operating a cursor movement event, a click event, or a keyboard input event of the conference terminal. In implementation, after the number of times that the continuous number of times of the face image of the first participant is not detected in the shot picture of the first participant exceeds the threshold value, it may be determined whether the duration of the operation information of the current non-detected participant terminal exceeds the specified duration. For example, it is determined whether the time of the operation time such as the last trigger operation of the primary participant and the current time difference exceeds a specified duration. If it is determined whether the duration of the operation information of the conference terminal is not currently detected exceeds the designated duration, it may be determined that the conference state of the conference participant is a keep-away state.

And 102, the conference terminal responds to the conference state of the first participant as the temporary-away state, and sends a notification of the first temporary-away state to the conference management service.

The first temporary-away state notification may carry information such as an account identifier corresponding to the first participant or a terminal identifier of the participant terminal.

Step 103, after receiving the notification of the first temporary-away state, the conference management service executes management operation on conference data in the online conference.

In an example, the conference management service performing the management operation may be the conference management service performing a screen recording process on conference data in the online conference data.

In an implementation, if the conference host configures the conference participant to perform screen recording processing on the online conference, that is, the first participant may store video data and audio data in the online conference, and the first participant has cloud recording authority, the conference host may perform screen recording processing on the online conference through the conference management service, that is, receive and store video data and audio data of the online conference sent to the conference terminal of the first participant.

In another example, the conference management service may perform the management operation by sending a conference data storage notification to the conference terminal. The conference terminal stores video data and audio data of the currently received online conference in response to receiving the conference data storage notification.

In an implementation, if the conference moderator configures the conference participant to perform a screen recording process on the online conference, but the first conference participant does not have cloud recording authority, the conference management service may send a conference data storage notification to the conference terminal. After receiving the conference data storage notice, the participant terminal corresponding to the first participant can perform screen recording processing, namely, store the video data and the audio data of the received online conference.

In still another example, the conference management service may further perform a management operation, where the conference management service obtains audio data of other participants in the online conference, converts the obtained audio data of each participant into text data, and sends the obtained text data corresponding to each participant to the conference terminal, where the conference terminal receives and stores the text data corresponding to each participant.

In implementation, if the conference host configures that the conference participant cannot perform screen recording processing on the online conference, the conference management service may acquire audio data in the online conference after receiving the first temporary state notification sent by the conference terminal, and then perform text recognition processing on the acquired audio data, so as to convert the audio data in the online conference into text data. The acquired audio data of the online conference may include audio data corresponding to each participant except the first participant. Thus, when the text recognition processing is performed on the audio data, the text data corresponding to the audio data of each participant can be recognized respectively. For each participant text data identified, the conference management service may send each participant text data to the first participant's conferencing terminal for storage.

In addition, the conference data stored in the step can also include conference control information in the online conference, such as setting information of the conference host on the online conference permission, conference interaction information, such as a hand lifting request triggered by the participant in the online conference, participant meeting return information and the like.

And 104, responding to the meeting state of the first meeting participant, changing the meeting state from the temporarily-away state to the listening state, and displaying meeting data corresponding to the management operation through a meeting data playback window.

In an implementation, after determining that the conference state of the first participant changes from the pause state to the listening state, the conference terminal may display a conference data playback window in a display interface of the conference terminal, and the conference data stored through the storage process is displayed by the display conference data playback window.

When the conference data is stored by the conference terminal, the conference terminal can display the stored conference data in a conference data playback window. For example, video data and audio data of an online conference recorded by a conference terminal of a first participant in a stay-away state are played, or text data corresponding to voices of other conference participants recognized by a conference management service of the first participant in the stay-away state are displayed. The recorded video data and audio data of the online conference and text data corresponding to the voice of the participants can be played simultaneously. In this way, the primary participant can select to mute and watch the recorded video data, and the communication content of other participants in the temporary-away state of the primary participant is determined through the displayed text data. So that the normal play of the audio data and the video data of the current online conference is not affected.

When conference data is stored in the cloud platform by the conference management service, the conference terminal can send an acquisition request corresponding to the conference data to the conference management service, and after receiving the acquisition request sent by the conference terminal, the conference management service can send the stored conference data to the conference terminal, and the conference terminal displays the conference data through a conference data playback window.

In the embodiment of the application, the conference terminal can detect the conference state of the first participant in the process that the first participant participates in the online conference, and can store conference data of the online conference through conference management service or the conference terminal when the conference terminal determines that the first participant is in a state of not watching and listening to the online conference content. When the first participant watches and listens to the online conference content again, the conference data stored by the first participant in the process of the temporary-away state can be played back, and further the first participant can be prevented from missing the online conference content.

In one implementation, the change of the conference state of the primary participant from the off-state to the listening state may be triggered by the primary participant, and the corresponding processing includes displaying an off-off state control in an on-line conference interface of the conference terminal in response to the conference state of the primary participant being the off-state. In response to a click operation of the cancel transient state control, it is determined that the conference state of the primary participant is changed from the transient state to the listening state.

As shown in fig. 2, when the conference state of the first participant determined by the conference terminal is a suspension state, a suspension release state control may be displayed on an online conference interface of the conference terminal. The pause-release-state control can be covered on an online conference interface, and when the pause-release-state control is displayed, the gray processing can be carried out on conference pictures displayed in the online conference interface, or the audio playing of the online conference can be closed. When the primary participant needs to listen to and view the conference content of the online conference again, the debounce state control can be clicked. And after the detected click operation of the pause state release control, the conference terminal determines that the conference state of the first conference participant is changed from the pause state to the listening state.

The change of the conference state of the first participant to the listening state may also be that the conference terminal detects a face image of the first participant or operation information of the conference terminal. For example, when the conference terminal detects that the face image of the first participant or the operation information of the conference terminal is obtained in the process that the first participant is in the transient state, it can be determined that the first participant is changed from the transient state to the listening state.

After determining that the first participant changes from the temporary state to the listening state, the conference terminal can acquire conference data stored in the first participant from the temporary state and display the conference data through a conference data playback window. The conference data playback window may be a window that is additionally created by the conference terminal and a window that is different from the window in which the conference terminal plays the current conference content.

In one implementation manner, after receiving the notification of the first temporary-away state, the conference management service sends a notification of a second temporary-away state to conference terminals corresponding to other conference participants in the online conference, where the notification of the second temporary-away state is used to indicate the conference terminals that receive the second temporary-away state, and a temporary-away identifier is added in a window corresponding to the first conference participant.

As shown in fig. 3, after receiving the notification of the second suspension state corresponding to the first participant, the conference terminal corresponding to the other participants may add a suspension identifier near the window displaying the conference picture of the first participant and the account of the first participant. The stay away indicator may be a clock icon that indicates that the primary participant is currently in a stay away state.

Accordingly, the conference terminal may further send a first listening state notification to the conference management service after determining that the first participant changes from the suspension state to the listening state. The conference management service may stop the storage processing of conference data in the online conference after receiving the first listening state notification. And may also send a second listening state notification corresponding to the primary participant to the terminals of the other participants. After receiving the second listening state notification corresponding to the first participant, the terminals of the other participants can cancel the temporary identifier added near the window displaying the first participant reference picture and the account of the first participant.

Therefore, in the embodiment of the application, after the meeting participants in the online meeting are in the temporary-away state, the meeting management service can inform other meeting participants of the information that the meeting participants are in the temporary-away state, so that interaction between other meeting participants and the meeting participants in the temporary-away state in the online meeting can be avoided, and the communication efficiency of the meeting participants in the online meeting can be improved.

In one implementation, in the process that the meeting state of the first meeting participant is in the transient state, when other meeting participants interact with the first meeting participant in the online meeting, the other meeting participants can be further reminded that the first meeting participant is in the transient state.

In an example, the conference management service, in response to detecting identity information of a participant in audio data of other participants in the online conference, sends prompt information to a participant terminal corresponding to the other participants, where the prompt information is used to indicate that the first participant is in a temporary-away state.

In implementation, the conference management service may perform text recognition processing on audio data sent by each conference participant terminal in the online conference (that is, audio data of a participant recorded by the conference participant terminal). The conference management service may store identity information corresponding to the attendees currently in a stay away state. The identity information corresponding to the attendees may include names, account names, and the like of the attendees. The conference management service detects the identity information of the first participant in the temporary-away state in the result of performing text recognition processing on the audio data corresponding to the second participant. It is determined that the secondary participant may be currently communicating with the primary participant in an online meeting. Therefore, the conference management service may send the prompt information to the conference terminal corresponding to the second participant again. After receiving the prompt message corresponding to the first participant, the second participant can perform text reminding in the online conference interface, for example, display "XX (identity information of the first participant) in the online conference interface is in a temporary-away state at present", or voice play "XX is in a temporary-away state at present".

In another example, in a process that the conference state of the first participant is in a temporary-away state, the conference management service sends prompt information to conference terminals corresponding to other participants in response to receiving interaction operation of the other participants and the first participant, where the prompt information is used for indicating that the first participant is in the temporary-away state.

In an implementation, if the conference management service obtains that other participants are interacting with the primary participant, for example, the tertiary participant is at the chat interface "@" with the primary participant. The conference management service may send a prompt message to the conference terminal corresponding to the third participant. After receiving the prompt message corresponding to the first participant, the third participant can carry out text reminding in the chat interface, for example, display that XX is in a temporary state currently, or play voice that XX is in a temporary state currently.

Therefore, in the embodiment of the application, when the first participant is in the temporary-away state, if other participants which communicate and interact with the first participant exist in the online conference, the conference management service can further remind the other participants that the first participant is in the temporary-away state, so that invalid communication in the online conference can be avoided, and the communication efficiency of the participants in the online conference can be improved.

Fig. 4 is a flowchart of a method for presenting conference data according to an embodiment of the present application, where the method may be applied to a conference system including a cloud platform and conference terminals. A conference management service is run in the cloud platform, further the conference management service may further include a conference control service, a recording service, a translation service, a media service, and a messaging service. The participant a in fig. 4 may be the first participant, the participant B may be the other participant, and in fig. 4, the participant a and the participant B may also represent participant terminals respectively operated by the participant a and the participant B. Referring to fig. 4, the method includes:

step S1, a conference terminal corresponding to a conference participant A sets a temporary-away state of the conference participant A to a conference control service.

When the conference terminal corresponding to the conference participant A detects that the conference participant A is in the temporary-away state, a temporary-away state notification can be sent to the conference control service so as to set the conference state of the conference participant A as the temporary-away state in the conference control service.

In the conference control service, a conference state corresponding to each participant in the online conference can be recorded, and the conference state corresponding to each participant is set as a listening state by default.

And S2, the conference control service returns a successful notice of the setting state to the conference participant A.

In an example, the setting state success notification may be the conference data storage notification in the above-described embodiment.

Step S3, the conference control service informs other participants (participant B) and participant A to be in a temporary state.

Therefore, other participants can be reminded that the participant A is in a temporary-away state, and invalid communication between the other participants and the participant A can be avoided.

And S4, starting local screen recording processing by the conference terminal corresponding to the conference participant A.

In an example, after receiving a successful notification of a setting state sent by a conference control service, a conference terminal corresponding to a conference participant a may start local screen recording processing, that is, store video data and audio data of an online conference.

And S5, transmitting a cloud recording request to the recording service by the meeting terminal corresponding to the meeting participant A.

In an example, after receiving a successful notification of a setting state sent by a conference control service, a conference terminal corresponding to a conference participant a may send a cloud recording request to a recording service if it is determined that a conference host configures the conference participant to perform screen recording processing on an online conference and the conference participant a has cloud recording authority, so that the recording service starts cloud recording processing on the online conference.

And S6, the conference terminal corresponding to the conference participant A sends a voice text transfer request to the translation service.

And S7, the translation service sends the speaking voice text conversion result of other participants to the conference terminal corresponding to the participant A.

And S8, the conference terminal corresponding to the conference participant A stores a voice text conversion result.

In implementation, the conference terminal corresponding to the conference participant a may only perform any one of the steps S4 and S5, and the execution of the steps S4 and S5 does not affect the execution of the step S6.

Step S9, the participant B calls the participant A to the media service.

In an example, a call function between participants may be set in an online conference, and after a participant B successfully calls a participant a, a participant terminal corresponding to the participant a may display a prompt message that the participant B is calling the participant a.

Step S10, the media service inquires that the meeting participant A is in a temporary-away state through the meeting control service.

Step S11, the media service notifies the message service that the meeting participant A is in a temporary-away state.

In step S12, the message service will notify the participant B that the participant a is in a suspension state.

Therefore, when other participants (such as participant B) call participant A in a temporary-away state, the message service can send notification that participant A is in the temporary-away state to participant B, so that ineffective communication between participant B and participant A can be avoided, and further communication efficiency of online conferences can be improved.

And step S13, the conferee B sends 2@the conferee A in the chat to the message service.

In an example, an online meeting may be provided with a text chat function between participants, and participant B may @ participant a in a chat dialog, thereby reminding participant a that current participant B is looking for participant a chat.

In step S14, the message service queries that the meeting participant a is in a stay-away state through the meeting control service.

In step S15, the message service will notify the participant B that the participant a is in a suspension state.

Therefore, when other participants (such as participant B) are in a temporary-away state in the chat, the message service can send a notification that the participant A is in the temporary-away state to the participant B, so that invalid communication between the participant B and the participant A can be avoided, and further the communication efficiency of the online conference can be improved.

And S16, setting the conference participant A to cancel the temporary state by the conference participant terminal corresponding to the conference participant A.

In step S17, the conference control service notifies other participants (including participant B), and participant a is in a listening state.

Step S18, the conference terminal corresponding to the conference participant A plays conference data stored in the temporary-away state by the conference participant A.

Therefore, the conference participant A can acquire conference content of the conference participant A in a temporary-away state through conference data played by the conference participant terminal, so that the conference content in an online conference can be prevented from being missed, and the communication efficiency of the conference participant in the online conference is improved.

The application also provides a conference system, as shown in fig. 5, comprising a cloud platform and a conference terminal, wherein the cloud platform comprises conference management service, and the conference management service comprises the following steps:

and the conference terminal 510 is configured to obtain a conference state of a first participant corresponding to the conference terminal in an online conference, where the conference state includes a listening state or a suspension state.

And the conference terminal 510 is configured to send a notification of the first conference state to the conference management service in response to the conference state of the first participant being the conference state.

The conference management service 520 is configured to perform a management operation on conference data in an online conference after receiving the first suspension state notification.

And the conference terminal 510 is configured to display conference data corresponding to the management operation through the conference data playback window in response to the conference state of the first participant changing from the suspension state to the listening state.

In one implementation manner, during the process that the meeting state of the first meeting participant is in the keep-away state, the meeting management service 520 is configured to, in response to detecting the identity information of the first meeting participant in the audio data of other meeting participants in the online meeting, send a prompt message to the meeting terminal corresponding to the other meeting participants, where the prompt message is used to indicate that the first meeting participant is in the keep-away state.

In one implementation manner, in a process that the conference state of the first participant is in a temporary-away state, the conference management service is configured to, in response to receiving an interaction operation between the other participants and the first participant, send a prompt message to a conference terminal corresponding to the other participants, where the prompt message is used to indicate that the first participant is in the temporary-away state.

In one implementation manner, the conference terminal 510 is configured to acquire a picture of a first participant captured by the conference terminal according to a detection period, detect whether a face image of the first participant exists on the picture of the first participant after each acquisition of the picture of the first participant, and determine, in response to a number of times that the face image of the first participant is not detected exceeding a number threshold, that a conference state of the first participant is a transient state.

In one implementation manner, the conference terminal 510 is configured to determine that the conference state of the first participant is a keep-away state in response to the number of times the face image of the first participant is not detected exceeding the number threshold, and no operation information of the conference terminal is detected within a specified duration.

In one implementation, the conference management service 520 is used to send conference data store notifications to conference terminals. The conference terminal stores video data and audio data of the currently received online conference in response to receiving the conference data storage notification.

In one implementation, the conference management service 520 is configured to obtain audio data of other participants in the online conference, and convert the obtained audio data of each participant into text data. The conference management service is used for sending the obtained text data corresponding to each participant to the conference terminal. The conference terminal is used for receiving and storing text data corresponding to each conference participant.

In one implementation manner, the conference management service 520 is configured to send, after receiving the first temporary-away status notification, a second temporary-away status notification to a conference terminal corresponding to another conference participant in the online conference, where the second temporary-away status notification is configured to instruct the conference terminal corresponding to the other conference participant to add a temporary-away identifier in a display window corresponding to the first conference participant.

In one implementation, the conference terminal 510 is configured to display a cancel-suspend state control in an online conference interface of the conference terminal in response to the conference state of the first participant being a suspend state, and determine that the conference state of the first participant is updated from the suspend state to a listening state in response to a click operation on the cancel-suspend state control.

Both the conference terminal 510 and the conference management service 520 may be implemented by software or may be implemented by hardware. Illustratively, the implementation of conference management service 520 is described next. Similarly, the implementation of the conference terminal 510 may refer to the implementation of the conference management service 520.

Module as an example of a software functional unit, conference management service 520 may include code running on a computing instance. Wherein the computing instance may be at least one of a physical host (computing device), a virtual machine, a container, etc. computing device. Further, the computing device may be one or more. For example, conference management service 520 may include code running on multiple hosts/virtual machines/containers. It should be noted that, multiple hosts/virtual machines/containers for running the application may be distributed in the same region, or may be distributed in different regions. Multiple hosts/virtual machines/containers for running the code may be distributed among the same AZ or among different AZs, each AZ including one data center or multiple geographically close data centers. Wherein typically a region may comprise a plurality of AZs.

Also, multiple hosts/virtual machines/containers for running the code may be distributed in the same VPC, or may be distributed among multiple VPCs. Where typically one VPC is placed within one region. The inter-region communication between two VPCs in the same region and between VPCs in different regions needs to set a communication gateway in each VPC, and the interconnection between the VPCs is realized through the communication gateway.

Module as an example of a hardware functional unit, conference management service 520 may include at least one computing device, such as a server or the like. Or conference management service 520 may be a device implemented using an ASIC, a PLD, or the like. Wherein, the PLD can be CPLD, FPGA, GAL or any combination thereof.

The multiple computing devices included in conference management service 520 may be distributed in the same region or may be distributed in different regions. The plurality of computing devices included in the YY device may be distributed in the same AZ or may be distributed in different AZ. Likewise, the plurality of computing devices included in the YY apparatus may be distributed in the same VPC, or may be distributed in a plurality of VPCs. Wherein the plurality of computing devices may be any combination of computing devices such as servers, ASIC, PLD, CPLD, FPGA, and GAL.

The present application also provides a computing device 100. As shown in fig. 6, computing device 100 includes a bus 102, a processor 104, a memory 106, and a communication interface 108. Communication between the processor 104, the memory 106, and the communication interface 108 is via the bus 102. Computing device 100 may be a server or a terminal device. It should be understood that the present application is not limited to the number of processors, memories in computing device 100.

Bus 102 may be a peripheral component interconnect standard (PERIPHERAL COMPONENT INTERCONNECT, PCI) bus, or an extended industry standard architecture (extended industry standard architecture, EISA) bus, among others. The buses may be divided into address buses, data buses, control buses, etc. For ease of illustration, only one line is shown in fig. 6, but not only one bus or one type of bus. Bus 102 may include a path to transfer information between various components of computing device 100 (e.g., memory 106, processor 104, communication interface 108).

The processor 104 may include any one or more of a central processing unit (central processing unit, CPU), a graphics processor (graphics processing unit, GPU), a Microprocessor (MP), or a digital signal processor (DIGITAL SIGNAL processor, DSP).

The memory 106 may include volatile memory (RAM), such as random access memory (random access memory). The memory 106 may also include non-volatile memory (ROM), such as read-only memory (ROM), flash memory, mechanical hard disk (HARD DISK DRIVE, HDD) or solid state disk (SSD STATE DRIVE).

The memory 106 has stored therein executable program code that is executed by the processor 104 to implement the aforementioned functionality of the conference terminal 510 or conference management service 520, respectively, to implement a method of presenting conference data. That is, the memory 106 has instructions stored thereon for performing the method of presenting meeting data.

Communication interface 108 enables communication between computing device 100 and other devices or communication networks using a transceiver module such as, but not limited to, a network interface card, transceiver, or the like.

The embodiment of the application also provides a computing device cluster. The cluster of computing devices includes at least one computing device. The computing device may be a server, such as a central server, an edge server, or a local server in a local data center. In some embodiments, the computing device may also be a terminal device such as a desktop, notebook, or smart phone.

As shown in fig. 7, the cluster of computing devices includes at least one computing device 100. The same instructions for performing the method of exposing meeting data may be stored in memory 106 in one or more computing devices 100 in the computing device cluster.

In some possible implementations, portions of instructions for performing the method of presenting meeting data may also be stored in the memory 106 of one or more computing devices 100 in the cluster of computing devices, respectively. In other words, a combination of one or more computing devices 100 may collectively execute instructions for performing a method of presenting meeting data.

It should be noted that the memories 106 in different computing devices 100 in the computing device cluster may store different instructions for performing part of the functions of the conference management service 520, respectively.

In some possible implementations, one or more computing devices in a cluster of computing devices may be connected through a network. Wherein the network may be a wide area network or a local area network, etc. Fig. 8 shows one possible implementation. As shown in fig. 8, two computing devices 100A and 100B are connected by a network. Specifically, the connection to the network is made through a communication interface in each computing device. In this type of possible implementation, instructions for the functionality of the participant terminal 510 are stored in the memory 106 in the computing device 100A. Meanwhile, instructions to perform the functions of conference management service 520 are stored in memory 106 in computing device 100B.

The manner of connection between clusters of computing devices shown in fig. 8 may be in view of the method of presenting meeting data provided by the present application that needs to be implemented by a cloud platform, and thus in view of the functionality implemented by meeting management service 520 being performed by computing device 100B.

It should be noted that the memory 106 in different computing devices 100 in the computing device cluster may store different instructions for performing part of the functionality of the conferencing system. That is, the instructions stored by memory 106 in different computing devices 100 may implement different functions in conferencing terminal 510 and conference management service 520.

Embodiments of the present application also provide a computer program product comprising instructions. The computer program product may be software or a program product containing instructions capable of running on a computing device or stored in any useful medium. The computer program product, when run on at least one computing device, causes the at least one computing device to perform a method of presenting meeting data.

The embodiment of the application also provides a computer readable storage medium. The computer readable storage medium may be any available medium that can be stored by a computing device or a data storage device such as a data center containing one or more available media. The usable medium may be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid state disk), etc. The computer-readable storage medium includes instructions that direct a computing device to perform a method of presenting meeting data.

The terms "first," "second," and the like in this disclosure are used for distinguishing between similar elements or items having substantially the same function and function, and it should be understood that there is no logical or chronological dependency between the terms "first," "second," and no limitation on the amount or order of execution. It will be further understood that, although the following description uses the terms first, second, etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another element. The term "at least one" in the present application means one or more, and the term "plurality" in the present application means two or more.

It should be noted that the above-mentioned embodiments are merely for illustrating the technical solution of the present application, and not for limiting the same, and although the present application has been described in detail with reference to the above-mentioned embodiments, it should be understood by those skilled in the art that the technical solution described in the above-mentioned embodiments may be modified or some technical features may be equivalently replaced, and these modifications or substitutions do not make the essence of the corresponding technical solution deviate from the protection scope of the technical solution of the embodiments of the present application.

Claims

1. A method for displaying conference data, wherein the method is applied to a conference system, the conference system comprises a cloud platform and a conference terminal, the cloud platform comprises a conference management service, and the method comprises the following steps:

the conference terminal acquires a conference state of a first participant corresponding to the conference terminal in an online conference, wherein the conference state comprises a listening state or a temporary-away state;

The conference terminal responds to the conference state of the first participant as a temporary-away state, and sends a first temporary-away state notification to the conference management service;

after receiving the first temporary-away state notification, the conference management service executes management operation on conference data of the online conference;

and the conference terminal responds to the conference state of the first conference participant to change from the temporary state to the listening state, and displays conference data corresponding to the management operation through a conference data playback window.

2. The method according to claim 1, wherein the method further comprises:

In the process that the conference state of the first conference participant is in the temporary-away state, the conference management service responds to the fact that the identity information of the first conference participant is detected in the audio data of other conference participants in the online conference, and sends prompt information to conference terminals corresponding to the other conference participants, wherein the prompt information is used for indicating that the first conference participant is in the temporary-away state.

3. The method according to claim 1, wherein the method further comprises:

in the process that the conference state of the first conference participant is in the temporary separation state, the conference management service responds to the received interaction operation of the other conference participants and the first conference participant, and sends prompt information to conference terminals corresponding to the other conference participants, wherein the prompt information is used for indicating that the first conference participant is in the temporary separation state.

4. A method according to any of claims 1 to 3, wherein the conferencing terminal obtaining a conferencing status of a first participant corresponding to the conferencing terminal in an online conference, comprising:

acquiring a picture of a first participant shot by a participant terminal according to a detection period;

After each time of obtaining the picture of the first participant, detecting whether a face image of the first participant exists or not in the picture of the first participant;

And determining that the conference state of the first participant is a temporary state in response to the fact that the continuous times of the face images of the first participant are not detected to exceed a time threshold.

5. The method of claim 4, wherein the determining that the conference status of the primary participant is a conference-away status in response to the number of consecutive times that no face image of the primary participant is detected exceeding a number of times threshold comprises:

And determining that the conference state of the first conference participant is a temporary-away state in response to the fact that the continuous times of the face images of the first conference participant are not detected to exceed a time threshold and the operation information of the conference terminal is not detected within a specified time length.

6. The method of any of claims 1 to 5, wherein the performing management operations on conference data in the online conference comprises:

The conference management service sends a conference data storage notice to the conference terminal;

and the conference terminal responds to the received conference data storage notification to store the currently received video data and audio data of the online conference.

7. The method of any of claims 1 to 5, wherein the performing management operations on meeting data of the online meeting comprises:

The conference management service acquires audio data of other participants in the online conference, and converts the acquired audio data of each participant into text data;

The conference management service sends the obtained text data corresponding to each conference participant to the conference terminal;

And the conference terminal receives and stores the text data corresponding to each conference participant.

8. The method according to any one of claims 1 to 7, further comprising:

And after receiving the first temporary-away state notification, the conference management service sends a second temporary-away state notification to the conference terminals corresponding to other conference participants in the online conference, wherein the second temporary-away state notification is used for indicating the conference terminals corresponding to the other conference participants to add temporary-away identifiers in display windows corresponding to the first conference participants.

9. The method according to any one of claims 1 to 8, further comprising:

Responding to the conference state of the first conference participant as a temporary-away state, and displaying a temporary-away state release control in an online conference interface of the conference terminal;

And responding to clicking operation of the pause state release control, and determining that the conference state of the first conference participant is updated from the pause state to the listening state.

10. A conference system, characterized in that the conference system comprises a cloud platform and conference terminals, the cloud platform comprises a conference management service, wherein:

the conference terminal is used for acquiring the conference state of a first participant corresponding to the conference terminal in an online conference, wherein the conference state comprises a listening state or a temporary-away state;

The conference terminal is used for responding to the conference state of the first conference participant as a temporary-away state and sending a first temporary-away state notification to the conference management service;

The conference management service is used for executing management operation on conference data of the online conference after receiving the first temporary-away state notification;

And the conference terminal is used for responding to the conference state of the first conference participant to change from the temporary state to the listening state, and displaying conference data corresponding to the management operation through a conference data playback window.

11. The conference system of claim 10 wherein, during the period when the conference state of the first participant is in the keep-away state, the conference management service is configured to send, in response to detecting the identity information of the first participant in the audio data of the other participants in the online conference, a prompt message to a conference terminal corresponding to the other participants, where the prompt message is used to indicate that the first participant is in the keep-away state.

12. The conference system according to claim 10, wherein, in a process that the conference state of the first participant is in the stay-away state, the conference management service is configured to send, in response to receiving an interaction operation between the other participant and the first participant, a prompt message to a conference terminal corresponding to the other participant, where the prompt message is used to indicate that the first participant is in the stay-away state.

13. The conference system according to any one of claims 10 to 12, wherein the conference terminal is configured to acquire a picture of a first participant captured by the conference terminal according to a detection period, detect whether a face image of the first participant exists on the picture of the first participant after each acquisition of the picture of the first participant, and determine that a conference state of the first participant is a keep-away state in response to a number of times that no face image of the first participant is detected exceeding a number of times threshold.

14. The conference system of claim 13 wherein the conferencing terminal is configured to determine that the conferencing status of the primary participant is a stay away status in response to the number of consecutive times that no face image of the primary participant is detected exceeding a number of times threshold and no operational information of the conferencing terminal is detected within a specified duration.

15. The conference system according to any one of claims 10 to 14, wherein said conference management service is adapted to send a conference data storage notification to said conference terminals;

the conference terminal is used for responding to the received conference data storage notice and storing the currently received video data and audio data of the online conference.

16. The conference system according to any one of claims 10 to 14, wherein said conference management service is configured to acquire audio data of other participants in said online conference, and convert the acquired audio data of each participant into text data;

the conference management service is used for sending the obtained text data corresponding to each conference participant to the conference terminal;

And the conference terminal is used for receiving and storing text data corresponding to each conference participant.

17. The conference system according to any one of claims 10 to 16, wherein said conference management service is further configured to, after receiving said first suspension state notification, send a second suspension state notification to a conference terminal corresponding to another conference participant in said online conference, said second suspension state notification being configured to instruct said conference terminal corresponding to said other conference participant to add a suspension identifier in a display window corresponding to the first conference participant.

18. The conference system of any one of claims 10 to 17 wherein the conference terminal is further configured to display a cancel-suspend state control in an online conference interface of the conference terminal in response to the conference state of the primary participant being a suspend state, and to determine that the conference state of the primary participant is updated from a suspend state to the listening state in response to a click operation of the cancel-suspend state control.

19. A cluster of computing devices, comprising at least one computing device, each computing device comprising a processor and a memory;

The processor of the at least one computing device is configured to execute instructions stored in the memory of the at least one computing device to cause the cluster of computing devices to perform the method of any one of claims 1 to 9.

20. A computer program product containing instructions that, when executed by a cluster of computing devices, cause the cluster of computing devices to perform the method of any of claims 1 to 9.

21. A computer readable storage medium comprising computer program instructions which, when executed by a cluster of computing devices, perform the method of any of claims 1 to 9.