CN114125164B - Converged office communication terminal, method and device - Google Patents

Abstract

The embodiment of the invention relates to the technical field of conference terminals and discloses a converged office communication terminal which comprises a central processing unit, and a display screen, a camera, a microphone module, a loudspeaker, a communication module and a PSTN module which are connected with the central processing unit; the PSTN module is internally provided with a telephone access number for communication connection with a PSTN telephone terminal, the central processing unit is used for running an operating system, and the operating system is provided with conference application software; the conference application software is used for communication connection with an intelligent terminal. The converged office communication terminal solves the problems of information island and inconvenient collaboration by arranging the PSTN module, conference application software and the like in the converged office communication terminal, and can realize intercommunication among multiple functions to achieve the purpose of high-efficiency and convenient communication.

Description

Converged office communication terminal, method and device

Technical Field

The invention relates to the technical field of conference office, in particular to a converged office communication method and device.

Background

At present, information communication in the current office scenario is a common requirement. Especially, due to the influence of new epidemic situations, more and more companies or units are arranged at home for office work and mixed office work, and new requirements are put on remote collaboration and communication solutions. Computers, fixed telephones, conference devices and the like are common office devices, wherein the fixed telephones, the conference devices and the like belong to special communication devices and the like, and the computers also become important communication tools along with the popularity of office instant messaging software, cloud conference software and other tools and the like. Computers are often separate from conventional communication devices and cannot work cooperatively. The existing desktop office equipment is independent in physical form, and a software system is also independent, so that the problems of information island and inconvenient collaboration are caused. And a plurality of independent office equipment occupies a larger office desktop space, and the overall purchase cost is high and the actual utilization rate of each office equipment is low because the basic hardware of each equipment cannot be used commonly.

Disclosure of Invention

Aiming at the defects, the embodiment of the invention discloses a converged office communication method which can be used for integrating various conference platforms and can solve the problem that the utilization rate of office equipment is not high.

The first aspect of the embodiment of the invention discloses a converged office communication terminal, which comprises a central processing unit, and a display screen, a camera, a microphone module, a loudspeaker, a communication module and a PSTN module which are connected with the central processing unit; the PSTN module is internally provided with a telephone access number for communication connection with a PSTN telephone terminal, and the central processing unit is used for running an operating system which is provided with conference application software; the conference application software is used for carrying out communication connection with an intelligent terminal;

The camera is used for transmitting the shot video signals to the corresponding intelligent terminals, and the microphone module is used for transmitting the acquired audio signals to the corresponding intelligent terminals; the display screen is used for playing the received pictures transmitted by the intelligent terminal, and the loudspeaker is used for playing the received audio signals transmitted by the intelligent terminal.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the device further includes an IP communication module electrically connected to the central processing unit, where an IP network protocol is built in the IP communication module, and the IP network protocol includes one or more of an SIP communication protocol, an IMS communication protocol, an MGCP communication protocol, and an SCCP communication protocol; the IP communication module is used for carrying out communication connection with the IP telephone through the IP network protocol.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the display screen is a touch display screen, and the conference application software includes business application software.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the office communication terminal further includes a power input port, a video signal input port, a first network interface, a second network interface, a first usb communication interface, a second usb communication interface, and a telephone line interface;

the office communication terminal is also provided with a virtual USB camera and a virtual USB sound card; the office communication terminal is connected with external equipment through a virtual USB camera and a virtual USB sound card to provide corresponding camera shooting function, speaker function and microphone function.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, a video fusion device and an audio fusion device are disposed in the central processing unit, where the video fusion device is used for performing video signal interaction with the local camera, the external device and the conference application software, and the audio fusion device is used for performing audio signal interaction with the PSTN module and the conference application software.

In a first aspect of the embodiment of the present invention, a first switch module and a second switch module are disposed in the central processor, where the first switch module is used to control on-off of the PSTN module and the conference application software, and the audio fusion device and the video fusion device, and the second switch module is used to control on-off of each device of the office communication terminal, and the audio fusion device and the video fusion device.

The second aspect of the embodiment of the invention discloses a converged office communication method, which comprises the following steps:

Analyzing the received incoming call signal of the PSTN telephone terminal through the PSTN module to obtain a corresponding first audio/video signal;

Analyzing the received conference joining signal of the intelligent terminal through conference application software to obtain a corresponding second audio/video signal;

And transmitting the first audio and video signals, the second audio and video signals and the local audio and video signals to corresponding PSTN telephone terminals or intelligent terminals, and playing and displaying the first audio and video signals and the second audio and video signals locally.

In a second aspect of the embodiment of the present invention, the conference application analyzes the received conference joining signal of the intelligent terminal to obtain a corresponding second audio/video signal, and includes:

The background server receives a conference joining signal sent by the intelligent terminal, and establishes a connection relation with the converged office communication terminal according to the conference joining signal;

the background server sends the connection relation to the converged office communication terminal to carry out application calling on the converged office communication terminal;

The background server transmits the second audio and video signals acquired by the intelligent terminal to the converged office communication terminal;

The communication method further includes:

establishing a conference session with a conference terminal through a remote conference application; when the converged office communication terminal establishes connection with a conference terminal, all conference applications are started and corresponding conference joining information is generated.

A third aspect of an embodiment of the present invention discloses a converged office communication apparatus, including:

A first parsing module: the method comprises the steps of analyzing a received incoming call signal of a PSTN telephone terminal through a PSTN module to obtain a corresponding first audio/video signal;

And a second analysis module: the conference adding signal analyzing module is used for analyzing the received conference adding signal of the intelligent terminal through conference application software to obtain a corresponding second audio/video signal;

And an interaction module: the method is used for transmitting the first audio and video signals, the second audio and video signals and the local audio and video signals to corresponding PSTN telephone terminals or intelligent terminals, and playing and displaying the first audio and video signals and the second audio and video signals locally.

A fourth aspect of an embodiment of the present invention discloses an electronic device, including: a memory storing executable program code; a processor coupled to the memory; the processor invokes the executable program code stored in the memory to perform the converged office communication method disclosed in the first aspect of the embodiment of the present invention.

A fifth aspect of the embodiment of the present invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute the converged office communication method disclosed in the first aspect of the embodiment of the present invention.

Compared with the prior art, the embodiment of the invention has the following beneficial effects:

The converged office communication terminal solves the problems of information island and inconvenient collaboration by arranging the PSTN module, conference application software and the like in the converged office communication terminal, and can realize intercommunication among multiple functions to achieve the purpose of high-efficiency and convenient communication.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1 is a schematic block diagram of a circuit of a converged office communication terminal disclosed in an embodiment of the present invention;

fig. 2 is a schematic structural diagram of a converged office communication terminal according to an embodiment of the present invention;

FIG. 3 is a flow chart of a converged office communication method disclosed in an embodiment of the present invention;

FIG. 4 is a schematic flow diagram of a connection through conferencing application as disclosed in an embodiment of the present invention;

Fig. 5 is a schematic view of an audio/video path of a converged office communication terminal according to an embodiment of the present invention;

FIG. 6 is a schematic flow chart of implementing video stitching by the video fusion device according to the embodiment of the invention;

fig. 7 is a schematic flow chart of implementing video superimposition by the video fusion device disclosed in the embodiment of the invention;

Fig. 8 is a schematic structural diagram of a converged office communication device according to an embodiment of the present invention;

Fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

Reference numerals: 1. a display screen; 2. a host; 3. and (5) connecting wires.

Detailed Description

The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.

It should be noted that the terms "first," "second," "third," "fourth," and the like in the description and in the claims of the present invention are used for distinguishing between different objects and not necessarily for describing a particular sequential or chronological order. The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus.

With the popularity of tools such as office instant messaging software and cloud conference software, computers are also becoming important communication tools. Computers are often separate from conventional communication devices and cannot work cooperatively. The existing desktop office equipment is independent in physical form, and a software system is also independent, so that the problems of information island and inconvenient collaboration are caused. And a plurality of independent office equipment occupies a larger office desktop space, and the overall purchase cost is high and the actual utilization rate of each office equipment is low because the basic hardware of each equipment cannot be used commonly. The prior general solution to the problems is that all people adopt the same software, but the method is not very friendly for a user. Based on the above, the embodiment of the invention discloses a converged office communication terminal, a method, a device and a storage medium, and the converged office communication terminal in the embodiment of the invention solves the problems of information island and inconvenient collaboration by arranging a PSTN module, conference application software and the like in the converged office communication terminal, and can realize intercommunication among multiple functions to achieve the purpose of high-efficiency and convenient communication.

Example 1

As shown in fig. 1 and fig. 2, an embodiment of the present invention provides a converged office communication terminal, which includes a central processing unit, and a display screen 1, a camera, a microphone module, a speaker, a communication module, a PSTN module and a memory, which are connected with the central processing unit; the PSTN module is internally provided with a telephone access number for communication connection with a PSTN telephone terminal, and the central processing unit is used for running an operating system which is provided with conference application software; the conference application software is used for carrying out communication connection with an intelligent terminal;

The camera is used for transmitting the shot video signals to the corresponding intelligent terminals, and the microphone module is used for transmitting the acquired audio signals to the corresponding intelligent terminals; the display screen 1 is used for playing the received pictures transmitted by the intelligent terminal, and the loudspeaker is used for playing the received audio signals transmitted by the intelligent terminal.

The central processing unit, the microphone module, the loudspeaker, the communication module, the PSTN module, the memory and the like are arranged in the host 2; the scheme of the embodiment of the invention integrates the PSTN module and the conference application software into the same terminal, fuses the PSTN module and the conference application software, and sets corresponding calling rules to apply and call data to each module and the conference application. Setting PSTN module to make user realize telephone function by integrating communication terminal, which is similar to fixed phone, integrating IP telephone and PSTN telephone in the system to make user dial and answer voice telephone and video telephone; the whole use scene is expanded, the remote conference between the user and different types of companies is greatly facilitated, and the communication cost of the companies is reduced. In the whole conference process, better fusion of the teleconference and the telephone is realized; when a teleconference is started, a plurality of paths of audios can be accessed to join the teleconference by dialing and answering the telephone. Unlike telephone access of general conference systems, the scheme does not depend on conference systems (including third party conference systems) to have telephone access functions. The audio and video signals of the telephone are spliced and combined in the fusion office communication terminal (comprising a corresponding background system). The audio and video signals from the far end of the telephone are fused with audio and video signals collected locally by a user (a camera, a microphone and externally input audio and video signals) into one path of audio and video signals to be in butt joint with a conference system through scaling, splicing, superposition and other processes. Specifically, the user can connect the host computer with the external device through the connection line 3 to perform communication interaction.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, the device further includes an IP communication module electrically connected to the central processing unit, where an IP network protocol is built in the IP communication module, and the IP network protocol includes one or more of an SIP communication protocol, an IMS communication protocol, an MGCP communication protocol, and an SCCP communication protocol; the IP communication module is used for carrying out communication connection with the IP telephone through the IP network protocol.

In the embodiment of the invention, besides integrating IP application such as SKYPE in the terminal, the integrated communication terminal can integrate corresponding IP communication modules, after the setting is correctly completed, the integrated communication terminal keeps the IP communication modules in a standby state in an idle state, and other components keep normal work for monitoring incoming calls of external telephones. The purpose of keeping the IP communication module in a standby state when idle is to reduce energy consumption on the one hand, and on the other hand, consider that in some scenarios where charging is performed with access time, disconnecting the connection when idle can effectively reduce costs. The converged communication terminal can be used as an IP phone at the same time. After the network connection information and the IP telephone service provider information are properly set, the converged communication terminal can receive an incoming telephone call from the PSTN network, the mobile communication network, or the IP network when the IP network is connected. When dialing outwards, the PSTN network, the mobile communication network or the IP network can be selected to be used for calling through the function keys. The voice input and output of the voice communication module is realized by the connection of an analog line and a transmitter/receiver, and the SD-153 moving coil transmitter/receiver can be adopted in specific hardware implementation. The other path of signal through the branching multiplexing and the modem is accessed to the IP communication module. The IP communication module is controlled by the main controller. In a specific hardware implementation, the IP communication module is implemented by an internal ethernet module of the BCM6362 integrated access chip and an BCM53125S ethernet physical layer, which are connected through the reduced media independent interface RMII (ReducedMediaIndependentInterface).

As an alternative implementation manner, in the first aspect of the embodiment of the present invention, the display screen 1 is a touch display screen, and the conference application software includes business application software. The office communication terminal also comprises a power supply input port, a video signal input port, a first network interface, a second network interface, a first usb communication interface, a second usb communication interface and a telephone line interface;

the office communication terminal is also provided with a virtual USB camera and a virtual USB sound card; the office communication terminal is connected with external equipment through a virtual USB camera and a virtual USB sound card to provide corresponding camera shooting function, speaker function and microphone function.

The whole application range is greatly expanded through the function setting, so that the device can be used as a conference terminal and can be expanded into various devices for use, for example, the device can be expanded into an expansion screen of another device, and the expansion of the device screen is realized through the expansion screen. The touch display screen is used as an external display of the office computer. The office computer can transmit the audio and video signals output by the office computer to the converged office communication terminal through wired or wireless connection, and the input picture and the local picture are converged in the terminal and then displayed on the display screen 1. Only the picture of the office computer, only the picture of the terminal, or the two pictures are displayed in a superimposed manner, or the two pictures are displayed in a spliced manner. Through the function, the touch control display screen can be used as a second screen of an office computer, so that the utilization rate and the practical value of the terminal are improved.

The office communication terminal is further provided with the camera and the microphone, so that the office communication terminal can be further expanded into the camera or the microphone of another device, and the camera, the loudspeaker and the built-in microphone serve as peripherals of an office computer. The converged office communication terminal is not limited by the form of a computer, and can specially optimize a camera, a loudspeaker and a microphone for audio and video communication and provide high-quality audio and video capability. The office computer can be connected with the converged office communication terminal through a cable (such as a USB cable), and a USB camera and a USB sound card (a loudspeaker and a microphone) are virtually arranged in the terminal and used as peripherals of the office computer, so that special software is not required to be installed on the office computer.

As an optional implementation manner, in the first aspect of the embodiment of the present invention, a video fusion device and an audio fusion device are disposed in the central processing unit, where the video fusion device is used for performing video signal interaction with the local camera, the external device and the conference application software, and the audio fusion device is used for performing audio signal interaction with the PSTN module and the conference application software. The central processing unit is internally provided with a first switch module and a second switch module, the first switch module is used for controlling the on-off of the PSTN module and conference application software, the audio frequency fusion device and the video fusion device, and the second switch module is used for controlling the on-off of each device of the office communication terminal, the audio frequency fusion device and the video fusion device.

The video fusion device can scale, splice and superimpose the input video signals to be recombined into one path of video signal output. Video signals with different resolutions are input into a fusion device, and the videos are scaled to proper resolutions according to the resolution requirements of splicing or superposition and then spliced or superposition together to be used as one path of synthesized video output. The fifth image is six-path video source input, four paths of videos are selected, the resolutions of the four paths of videos are scaled (transformed) to 960 x 540, and a path of signal output with the resolution of 1920 x 1080 is spliced. Six paths of video source inputs are shown, two paths of video are selected, one path of resolution is scaled to 1280 x 720, and the two paths of video are taken as a main picture. The other path of video resolution is scaled to 640 x 360, and is overlapped on the main picture, and finally the overlapped video signals are synthesized and output. The specific scaling mode and the superposition mode can also provide corresponding ports for users to select.

The audio fusion device outputs the synthesized audio signals, the synthesized audio signals are accessed to each application through a switch 'K', and the audio signals are controlled to pass through the switch. As described above, through the video fusion device and the audio fusion device, audio signals and video signals of audio and video communication applications of different platforms can be mutually communicated, so that fusion communication of different platforms is realized. Better information synthesis can be realized through the audio and video fusion device, so that the whole output page is unified, the whole integrated design is improved, and the occurrence of scenes which cannot be uniformly managed due to different platforms is avoided.

Specifically, the host 2 of the converged office communication terminal provided by the embodiment of the invention is internally provided with a complete computer hardware platform (CPU, DDR, flash and the like) which can run an operating system (Android, linux and the like); video conferencing, video telephony, or other application software may be run; the touch control display screen is a main content display device and an interactive operation device; the built-in camera is used for recording images in video conference or video telephone applications. Speakers are used to play sound in video conferencing or video telephony applications; the built-in microphone is used for pickup in video conference or video telephone and other applications, and is also used for voice operation interaction; a microphone (wired or wireless) is arranged to facilitate use in making a call; built-in wifi, can connect the network through wifi; the built-in BT can be connected with a wireless headset, a microphone and the like through Bluetooth; the USB interface is provided with a USB1 interface and a USB2 interface, and can be used for connecting an office computer or a USB peripheral; a network interface 1 and a network interface 2 are provided; one of the network interfaces is for connecting to a network (switch) and the other is for providing a network to the other devices. The video input interface is arranged, and external video signals (such as video output of office computers and the like) can be accessed; the video output interface is matched, and display equipment such as a display or a projector can be externally connected to further expand application scenes; conference functions. Similar to the conference integration, the system integrates teleconferencing functionality, and users can reserve a conference, initiate an instant conference, or join a conference. Telephone functions. Similar to fixed telephone, the system integrates IP telephone and PSTN telephone functions. The user can make and receive voice calls and video calls. The equipment of the embodiment of the invention can greatly reduce the equipment purchase cost of a company, can be used as a conference machine, can be used as a computer expansion screen and the like, and has a small volume and a rich interface function in the aspect of movement.

The converged office communication terminal solves the problems of information island and inconvenient collaboration by arranging the PSTN module, conference application software and the like in the converged office communication terminal, and can realize intercommunication among multiple functions to achieve the purpose of high-efficiency and convenient communication.

Example two

Referring to fig. 3, fig. 3 is a flow chart of a converged office communication method according to an embodiment of the invention. The execution main body of the method described in the embodiment of the invention is an execution main body composed of software or/and hardware, and the execution main body can receive related information in a wired or/and wireless mode and can send a certain instruction. Of course, it may also have certain processing and storage functions. The execution body may control a plurality of devices, such as a remote physical server or cloud server and related software, or may be a local host or server and related software that performs related operations on a device that is located somewhere, etc. In some scenarios, multiple storage devices may also be controlled, which may be located in the same location or in different locations than the devices.

As shown in fig. 3, the converged office communication based method includes the steps of:

s101: analyzing the received incoming call signal of the PSTN telephone terminal through the PSTN module to obtain a corresponding first audio/video signal;

S102: analyzing the received conference joining signal of the intelligent terminal through conference application software to obtain a corresponding second audio/video signal;

S103: and transmitting the first audio and video signals, the second audio and video signals and the local audio and video signals to corresponding PSTN telephone terminals or intelligent terminals, and playing and displaying the first audio and video signals and the second audio and video signals locally.

The existing voice communication mode can only be used on the same platform, but can not be used for fusion processing of different platforms; the fusion terminal of the embodiment of the invention can break the limit of a plurality of different conference platforms, so that the conference selection of the user is free, and all participants do not need to download the same conference application and register corresponding numbers. The integrated office communication terminal is provided with a plurality of conference applications, such as a Tencentrated conference application, a Hua-Cheng conference application and the like, and is also provided with a skype application, an IP telephone application, a PSTN telephone application and the like. The PSTN telephone terminal, the intelligent terminal, the computer terminal and the like in the embodiment of the invention can be a conference terminal and a conference terminal, and the two terminals are consistent in specific meaning.

The communication method further includes:

establishing a conference session with a conference terminal through a remote conference application; when the converged office communication terminal establishes connection with a conference terminal, all conference applications are started and corresponding conference joining information is generated.

That is, when in use, the user can directly click on the teleconference, then all applications in the converged communication terminal are pulled up to be called or the user can select a certain number of conference applications at the beginning, then corresponding conference joining information is generated, that is, conference numbers, and then the user at the conference site can join the conference through the conference numbers. A user adopting a PSTN network or an IP network can directly call in telephone numbers to realize corresponding connection, and a user adopting a Tencentrated conference or a Huazhi conference can directly input conference numbers on corresponding pages of the users to join in corresponding conferences. However, in the use process, the user cannot use the product on different platforms, but uses the same platform, so that the consistency of the product use is improved. In practice, there may be various modes of operation that may choose to have certain applications open or to launch all conference applications after launching a certain application, both of which may be implemented.

When in use, the PSTN network can directly join or transfer through the number, but for commercial conference software such as a Tencel conference, the specific processing flow is as follows: fig. 4 is a schematic flow chart of connection through conference application software, as shown in fig. 4, where the conference application software parses a received conference joining signal of an intelligent terminal to obtain a corresponding second audio/video signal, and includes:

s1021: the background server receives a conference joining signal sent by the intelligent terminal, and establishes a connection relation with the converged office communication terminal according to the conference joining signal;

s1022: the background server sends the connection relation to the converged office communication terminal to carry out application calling on the converged office communication terminal;

s1023: the background server transmits the second audio and video signals acquired by the intelligent terminal to the converged office communication terminal;

because the corresponding application is started in the converged communication terminal, the converged communication terminal can receive a connection request sent by a corresponding background server and then realize the connection through feedback information; and because of adopting various conference software, the corresponding authority management is required to be set for performing the authority management on different software applications, such as how to cope with the hardware call conflict among various conference applications, the corresponding authority management is required to be set in advance, and then the corresponding authority allocation is performed.

Specifically, the flow diagram of conference application type judgment disclosed in the embodiment of the invention, the information fusion method further comprises:

acquiring software extraction interfaces of all currently running conference applications;

judging whether the current application is a closed communication application or an open communication application according to the software extraction interface;

If the corresponding conference application is an open communication application, transmitting video signals of the conference site end corresponding to the open communication application to a corresponding video fusion device;

if the corresponding conference application is a closed communication application, starting a video recording process to record the display picture at the fusion terminal, and converting the recorded video signal into a virtual camera signal to be sent to the conference site.

Specifically, the meaning of acquiring the software extraction interface is to determine whether the currently running conference application has the software extraction interface, if so, it can be determined to be an open communication application, and if not, it can be determined to be a closed communication application; the meaning of a closed communication application is that its video pictures cannot be extracted for sharing. Whereas the audio-visual signals in open communication applications can be extracted.

Specifically, the starting the video recording process to record the display screen at the fusion terminal and convert the recorded video signal into a virtual camera signal includes:

starting a video recording process to record a display picture at the fusion terminal so as to convert video signals at the conference site end into screen image signals;

and converting the screen image signal to obtain a corresponding virtual camera signal.

In order to open the barriers among a plurality of application platforms, the screen recording links are arranged to realize information interaction among a plurality of conference application platforms; starting a screen recording process at the converged communication terminal to record the video of the picture to be recorded, wherein the video recording is most preferably carried out on a full screen, so that better information acquisition efficiency can be realized; and then the acquired signals are packaged into virtual camera signals, and because different conference application platforms can receive the camera signals, the corresponding virtual camera components are called at the fusion communication terminal to package the recorded pictures and then sent to other application platforms, and the signals recognized at the conference application platforms are the camera signals, so that the signals can be acquired, namely, the video picture information extraction function is realized by setting a software extraction interface in a closed communication application.

Specifically, fig. 5 is a schematic view of an audio/video path of a converged office communication terminal according to the embodiment of the present invention, as shown in fig. 5, a teleconference-application (a … N) is audio/video teleconference software of a third party, and generally, no access or free version of such an application provides a signal path interface (i.e. a software extraction interface) of a video, which also makes software of different vendors unable to communicate, and is hereinafter referred to as a "closed audio/video communication application". IP telephony applications are typically communication software that provides a video signal path interface, which can be read directly by the host system to interact with video signals, hereinafter referred to as "open-type audiovisual communication applications". The closed audio and video communication application does not provide a software interface for acquiring video signals, but the output video of the closed audio and video communication application can be displayed on a display of the convergence communication terminal, namely, a user at a conference site can transmit a shot picture to the convergence communication terminal through the intelligent terminal of the closed audio and video communication application, but the closed audio and video communication application cannot receive the audio and video signals transmitted by the convergence communication terminal; in the implementation, a user can intercept a picture signal displayed by the display through the main control system. Thereby realizing extraction of output video content of the closed audio-video communication application, and the content can be input into a video fusion device for further processing. This is a key step in achieving a convergence of different communication software. The open audio and video communication application is provided with an open output video extraction interface, and the main control system can directly extract and input the video extraction interface into the video fusion device for further processing. The audio signals output by the closed audio-video communication application, the open audio-video communication application and the PSTN telephone can be extracted in the main control system and can enter an audio fusion device for processing. The local camera and the external video input are functions of the main control system, and video signals of the local camera and the external video input can be controlled by the main control system to be input into the video fusion device. The block denoted "K" in the figure is a signal switch, which controls whether a signal is input to the fusion device.

Public switched telephone network (PSTN-Public Switched Telephone Network), a telephone network commonly used in our daily lives. PSTN is a well known circuit switched network based on analog technology. Among the wide area network interconnection technologies, the communication cost required for interconnection through the PSTN is the lowest, but the data transmission quality and transmission speed are the worst, and the network resource utilization of the PSTN is also lower. Public switched telephone networks are standard telephone line based circuit switched services used as a connection method to connect remote endpoints. Typical applications are connections between remote endpoints and local LANs and remote user dial-up networking. PSTN provides an analog proprietary channel that is connected between channels via several telephone exchanges. When two hosts or router devices need to be connected through PSTN, the network access side (i.e. subscriber loop side) at both ends must use a Modem (Modem) to perform analog/digital, digital/analog conversion of the signal. From the perspective of the OSI seven layer model, the PSTN can be seen as a simple extension of the physical layer, without providing services to users for flow control, error control, etc. Moreover, since PSTN is a circuit-switched approach, a path is built up until released, and its full bandwidth can only be used by devices at both ends of the path, even if no data needs to be transferred between them. Therefore, this circuit switched approach does not allow for full utilization of network bandwidth. The interconnection of networks through the PSTN is specifically an interconnection of networks through the PSTN connecting two local area networks. In the two local area networks, each router is provided with a serial port which is connected with a Modem, and the Modem is connected with PSTN, so that the interconnection of the two local area networks is realized. The telephone conference application of PSTN is that the conference participants scattered in each place are organized by PSTN network channel and information means interconnected by multiple parties, and the communication form of service conference is carried out by telephone. The teleconference has the characteristics of convenience, rapidness, practicability and high efficiency, and saves a great deal of traffic, site and time cost. A novel conference mode for meeting by using telephone lines as carriers. The method is also popular in enterprises to a certain extent as an important conference mode, and can be deeply applied, namely, deeply fused with more commercial applications such as a Tencent conference and the like through the scheme of the embodiment of the invention.

Specifically, the video synthesized by the video fusion device is accessed to applications such as teleconference and IP telephone, and can be output to a local display. For closed audio and video communication application, a software interface for inputting video signals is generally not provided, the master control system virtualizes the synthesized video signals into one path of cameras, and the synthesized video signals are transmitted to all participants by selecting the path of cameras for input in the audio and video communication application. For open audio and video communication application, a software interface for inputting video signals is generally provided, and a master control system accesses the video signals through the interface, so that the effect of transmitting the synthesized video signals to all the participants is realized. The synthesized video signal is connected to each application or local display through a switch 'K', and whether the video signal passes through or not is controlled through the switch. When the method is implemented, recording and sharing can be performed after audio and video fusion is performed.

More specifically, the video fusion device performs fusion processing on video signals of each conference site end to display at a display module of the fusion office communication terminal, and includes:

the video fusion device acquires video signals of each conference site end, wherein the video signals comprise first resolution signals;

The video fusion device acquires a second resolution signal of the fusion office communication terminal;

According to the first resolution signal and the second resolution signal, performing display processing fusion processing on the video signals of all the conference sites so as to display the video signals at a display module of the fusion office communication terminal; the fusion process includes any one or more of scaling, stitching, and overlaying.

The video fusion device can scale, splice and superimpose the input video signals to be recombined into one path of video signal output. As shown in fig. 6 and fig. 7, fig. 6 is a schematic flow chart of implementing video stitching by the video fusion device disclosed in the embodiment of the present invention; fig. 7 is a schematic flow chart of implementing video superimposition by the video fusion device disclosed in the embodiment of the invention; video signals with different resolutions are input into a fusion device, and the videos are scaled to proper resolutions according to the resolution requirements of splicing or superposition and then spliced or superposition together to be used as one path of synthesized video output. The fifth image is six-path video source input, four paths of videos are selected, the resolutions of the four paths of videos are scaled (transformed) to 960 x 540, and a path of signal output with the resolution of 1920 x 1080 is spliced. Six paths of video source inputs are shown, two paths of video are selected, one path of resolution is scaled to 1280 x 720, and the two paths of video are taken as a main picture. The other path of video resolution is scaled to 640 x 360, and is overlapped on the main picture, and finally the overlapped video signals are synthesized and output. The specific scaling mode and the superposition mode can also provide corresponding ports for users to select.

More specifically, the communication method further includes:

Responding to a first switch signal input by a user, and controlling the on-off state of video connection with a corresponding meeting place end by the converged office communication terminal;

And responding to a second switch signal input by the user, and controlling the on-off state of the audio connection with the corresponding conference site by the converged office communication terminal.

By providing the interface, the user has higher independent selection right, and the user can manage the conference by fusing the communication terminals, such as opening or closing a channel to realize the management of the conference.

The conference application comprises one or more of an IP telephone application, a remote conference application and a PSTN telephone application; that is, it can be known that the scheme of the embodiment of the invention can support a plurality of different application platforms, not only support the conference platform such as the Tencent conference platform and the Hua conference platform, but also support the communication between the IP telephone application and the PSTN telephone application and the Tencent conference platform, so that the application range of the whole scheme is wider, the degree of freedom is higher, and communication among different enterprises is more convenient.

The communication method further comprises the steps of:

And receiving a computer screen signal of the main conference site and transmitting the computer screen signal to each sub conference site.

Besides the conference, the terminal of the embodiment of the invention can share the received computer screen signal of the main conference site, and the display content of the office computer is fused with the remote conference. Teleconferencing often requires sharing of content displayed by local office computers to participants. Many conference systems (particularly free cloud conference systems) can only share the content of the local machine, but cannot share the content input from the outside. In the scheme, the office computer can transmit audio and video signals output by the office computer to the converged office communication terminal through wired or wireless connection, the inside of the terminal is spliced with local signals, and then the content is displayed on the touch display screen. The conference system shares the desktop of the terminal, so that the display content of the office computer can be shared to each reference party. That is, when the user needs to share the content, the user at different meeting places can watch more conveniently. Specifically, the touch display screen can be used as an external display of an office computer. The office computer can transmit audio and video signals output by the office computer to the converged office communication terminal through wired or wireless connection, and the terminal fuses an input picture with a local picture and then displays the fused picture on a display screen. Only the picture of the office computer, only the picture of the terminal, or the two pictures are displayed in a superimposed manner, or the two pictures are displayed in a spliced manner. Through the function, the touch control display screen can be used as a second screen of an office computer, so that the utilization rate and the practical value of the terminal are improved.

Specifically, the scheme of the embodiment of the invention aims at a remote network audio/video conference scene, a conference is established by a main conference site by using a remote conference application A on a converged office communication terminal, and a conference is accessed by a sub conference site 1 by using the remote conference application A. While the conference room 2 is equipped with an IP telephony application, without the teleconferencing application 1, so the conference is accessed via IP telephony. The conference room 2 dials through the converged office communication terminal to establish connection.

The local camera signal of the main conference site, the external video (computer screen signal) of the main conference site, the video signal from the branch conference site 1 and the video signal from the branch conference site 2 are all input to the video fusion device, and are spliced into a path of composite video signal which is respectively output to the local display of the main conference site, the video input (virtual camera) of the remote conference application A and the video input (software interface) of the IP telephone. The local display, the conference room 1 and the conference room 2 can all display the synthesized video signal.

The local microphone audio signal of the main conference site, the audio signal from the branch conference site 1 and the audio signal from the branch conference site 2 are all input to the audio fusion device, one path of output audio is synthesized and output to the local loudspeaker, the audio input channel of the remote conference application A and the audio input channel of the IP telephone application. The local speaker, the conference room 1 speaker and the conference room 2 speaker can play the synthesized audio. Therefore, although the teleconference application a and the IP telephone are two independent platforms and cannot directly join the same conference, a joint conference is realized by fusing office communication terminals.

The main application scene of the heterogeneous conference fusion of the embodiment of the invention is as follows: in daily office, a multiparty conference is frequently carried out, and the parties cannot conveniently be connected by using different conference platforms. In the scheme, the converged office communication terminal can be carried with a plurality of different conference platforms. In a conference system, audio and video signals from all parties are fused into one path of audio and video signals in a fusion office communication terminal through scaling, splicing, superposition and other processes, and then are distributed to all conference platforms in a butt joint manner, so that conference fusion of different platforms is realized. The scheme does not depend on the conference pair-to-docking support of each conference platform to the different platform.

The information fusion method in the embodiment of the invention can unify the communication applications of a plurality of different platforms for use, so that users at different places and using different communication applications can be connected in a conference, the collaboration among teams is greatly improved, and the service efficiency is improved.

Example III

Referring to fig. 8, fig. 8 is a schematic structural diagram of a converged office communication device according to an embodiment of the present invention. As shown in fig. 8, the converged office communication apparatus may include:

The first parsing module 21: the method comprises the steps of analyzing a received incoming call signal of a PSTN telephone terminal through a PSTN module to obtain a corresponding first audio/video signal;

The second parsing module 22: the conference adding signal analyzing module is used for analyzing the received conference adding signal of the intelligent terminal through conference application software to obtain a corresponding second audio/video signal;

Interaction module 23: the method is used for transmitting the first audio and video signals, the second audio and video signals and the local audio and video signals to corresponding PSTN telephone terminals or intelligent terminals, and playing and displaying the first audio and video signals and the second audio and video signals locally.

The information fusion method in the embodiment of the invention can unify the communication applications of various different platforms, such as IP telephone application, PSTN telephone application and business meeting application, so that users in different places and using different communication applications can carry out meeting connection, and the collaboration among teams is greatly improved.

Example IV

Referring to fig. 9, fig. 9 is a schematic structural diagram of an electronic device according to an embodiment of the invention. The electronic device may be a computer, a server, or the like, and of course, may also be an intelligent device such as a mobile phone, a tablet computer, a monitor terminal, or the like, and an image acquisition device having a processing function. As shown in fig. 9, the electronic device may include:

a memory 510 storing executable program code;

a processor 520 coupled to the memory 510;

Wherein the processor 520 invokes executable program code stored in the memory 510 to perform some or all of the steps in the converged office communication method of the first embodiment.

The embodiment of the invention discloses a computer-readable storage medium storing a computer program, wherein the computer program causes a computer to execute part or all of the steps in the converged office communication method in the first embodiment.

The embodiment of the invention also discloses a computer program product, wherein when the computer program product runs on a computer, the computer is caused to execute part or all of the steps in the fusion office communication method in the first embodiment.

The embodiment of the invention also discloses an application release platform, wherein the application release platform is used for releasing the computer program product, and the computer is caused to execute part or all of the steps in the converged office communication method in the first embodiment when the computer program product runs on the computer.

In various embodiments of the present invention, it should be understood that the size of the sequence numbers of the processes does not mean that the execution sequence of the processes is necessarily sequential, and the execution sequence of the processes should be determined by the functions and internal logic thereof, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.

In addition, each functional unit in the embodiments of the present invention may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer-accessible memory. Based on this understanding, the technical solution of the present invention, or a part contributing to the prior art or all or part of the technical solution, may be embodied in the form of a software product stored in a memory, comprising several requests for a computer device (which may be a personal computer, a server or a network device, etc., in particular may be a processor in a computer device) to execute some or all of the steps of the method according to the embodiments of the present invention.

In the embodiments provided herein, it should be understood that "B corresponding to a" means that B is associated with a, from which B can be determined. It should also be understood that determining B from a does not mean determining B from a alone, but may also determine B from a and/or other information.

Those of ordinary skill in the art will appreciate that some or all of the steps of the various methods of the described embodiments may be implemented by hardware associated with a program that may be stored in a computer-readable storage medium, including Read-Only Memory (ROM), random-access Memory (RandomAccess Memory, RAM), programmable Read-Only Memory (Programmable Read-Only Memory, PROM), erasable programmable Read-Only Memory (Erasable Programmable Read-Only Memory, EPROM), one-time programmable Read-Only Memory (One-time Programmable Read-Only Memory, OTPROM), electrically erasable programmable Read-Only Memory (EEPROM), compact disc Read-Only Memory (Compact Disc Read-Only Memory, CD-ROM), or other optical disk Memory, magnetic disk Memory, tape Memory, or any other medium capable of being used to carry or store data.

The above describes the method, apparatus, electronic device and storage medium for converged office communication disclosed in the embodiments of the present invention in detail, and specific examples are applied herein to illustrate the principles and embodiments of the present invention, and the above description of the embodiments is only for helping to understand the method and core ideas of the present invention; meanwhile, as those skilled in the art will have variations in the specific embodiments and application scope in accordance with the ideas of the present invention, the present description should not be construed as limiting the present invention in view of the above.

Claims (5)

1. The converged office communication terminal is characterized by comprising a central processing unit, and a display screen, a camera, a microphone module, a loudspeaker, a communication module and a PSTN module which are connected with the central processing unit; the PSTN module is internally provided with a telephone access number for communication connection with a PSTN telephone terminal, and the central processing unit is used for running an operating system which is provided with conference application software; the conference application software is used for carrying out communication connection with an intelligent terminal;

the camera is used for transmitting the shot video signals to the corresponding intelligent terminals, and the microphone module is used for transmitting the acquired audio signals to the corresponding intelligent terminals; the display screen is used for playing the received pictures transmitted by the intelligent terminal, and the loudspeaker is used for playing the received audio signals transmitted by the intelligent terminal; the intelligent office communication system comprises a central processing unit, an audio fusion device, a PSTN module, a conference application software, a first switch module and a second switch module, wherein the central processing unit is internally provided with the video fusion device and the audio fusion device, the video fusion device is used for carrying out video signal interaction with the local camera, the external equipment and the conference application software, the audio fusion device is used for carrying out audio signal interaction with the PSTN module and the conference application software, the central processing unit is internally provided with the first switch module and the second switch module, the first switch module is used for controlling the on-off of the PSTN module and the conference application software and the audio fusion device and the video fusion device, the second switch module is used for controlling the on-off of each device of an office communication terminal, the audio fusion device and the video fusion device, and the central processing unit is used for executing a fusion office communication method, and the method comprises the following steps:

Analyzing the received incoming call signal of the PSTN telephone terminal through the PSTN module to obtain a corresponding first audio/video signal;

Analyzing the received conference joining signal of the intelligent terminal through conference application software to obtain a corresponding second audio/video signal;

And transmitting the first audio and video signals, the second audio and video signals and the local audio and video signals to corresponding PSTN telephone terminals or intelligent terminals, and playing and displaying the first audio and video signals and the second audio and video signals locally.

2. The converged office communication terminal of claim 1, further comprising an IP communication module electrically connected to the central processor, the IP communication module having an IP network protocol built therein, the IP network protocol including one or more of a SIP communication protocol, an IMS communication protocol, an MGCP communication protocol, and an SCCP communication protocol; the IP communication module is used for carrying out communication connection with the IP telephone through the IP network protocol.

3. The converged office communication terminal of claim 1, wherein the display screen is a touch display screen and the conference application software comprises business application software.

4. The converged office communication terminal of claim 1, wherein the office communication terminal further comprises a power input port, a video signal input port, a first network interface, a second network interface, a first usb communication interface, a second usb communication interface, and a telephone line interface;

the office communication terminal is also provided with a virtual USB camera and a virtual USB sound card; the office communication terminal is connected with external equipment through a virtual USB camera and a virtual USB sound card to provide corresponding camera shooting function, speaker function and microphone function.

5. The converged office communication terminal of claim 1, wherein the conference application software parses the received conference addition signal of the intelligent terminal to obtain a corresponding second audio/video signal, comprising:

The background server receives a conference joining signal sent by the intelligent terminal, and establishes a connection relation with the converged office communication terminal according to the conference joining signal;

the background server sends the connection relation to the converged office communication terminal to carry out application calling on the converged office communication terminal;

The background server transmits the second audio and video signals acquired by the intelligent terminal to the converged office communication terminal;

The communication method further includes:

establishing a conference session with a conference terminal through a remote conference application; when the converged office communication terminal establishes connection with a conference terminal, all conference applications are started and corresponding conference joining information is generated.