KR101223975B1 - The method and transport system of the simultaneous interpretation sound based on multi codec and multi channel - Google Patents

Abstract

The present invention relates to a simultaneous interpretation voice streaming system and to a method for providing user convenience and reducing the cost of installing a system for providing simultaneous interpretation services by at least two simultaneous interpreters in international conference halls, exhibition halls and seminars in multiple languages. will be. Through the present invention, it is possible to reduce the cost of the simultaneous interpreter receiver itself by enabling the user to listen to the simultaneous interpreter's voice in real time using a smartphone possessed by an individual instead of the simultaneous interpreter receiver provided in the existing simultaneous interpreter environment. You do not need to know how to operate the various types of simultaneous interpretation receivers.

Description

The method and transport system of the simultaneous interpretation sound based on multi codec and multi channel

The present invention relates to a simultaneous interpretation voice streaming system, and more particularly to a multi-codec, multi-channel based simultaneous interpretation voice transmission system and method.

In international conference halls, exhibition halls, and seminars in multiple languages, two or more simultaneous interpreters interpret the lecturer's lectures and input voice signals through an interpreter microphone. Simultaneous interpretation services have been provided by listening.

Background art of the present invention is disclosed in Korean Patent Publication No. 10-2011-0088776 (2011.08.04).
That is, in the existing simultaneous interpretation environment, the simultaneous interpretation receiver has been paid to all participants who attended the lecture. In addition, in the case of a large number of attendees, there is a lack of simultaneous interpretation receivers, so some attendees have not been able to receive simultaneous interpretation services.

Therefore, in the situation where smart phone dissemination is recently activated worldwide, it is required to supplement and replace the existing simultaneous interpretation system using the same.

The present invention provides a system and method for supplementing and replacing an expensive simultaneous interpretation system in an international conference hall, an exhibition hall, and a seminar that operate a conventional simultaneous interpretation system.

In addition, the present invention is not limited to the number of simultaneous interpretation languages by using the voice multiplexing (Muxing) and demultiplexing (Demuxing) technology, by multiplexing the multiple simultaneous interpretation voice (streaming) language by the streaming server position The system performance can be much better than that of providing a streaming service, and in recent years, high-end smartphones have been activated. In this situation, the server load is distributed to the smartphones of the listeners.

In addition, the codec technology is applied to improve the quality of the analog voice, and the encoding and decoding codec quality suitable for the network environment of the conference hall can be selected and used to provide the optimal voice quality according to the network load and the conference hall environment. .

According to one aspect of the invention, a simultaneous interpretation voice transmission system is provided.

Simultaneous interpretation voice transmission system according to an embodiment of the present invention,

A multi-codec encoder unit for converting an analog voice received from an interpreter's microphone into a digital voice;

A multi-channel multiplexer which multiplexes the multilingual interpreted voice data processed by the multi-codec encoder;

A streaming server transmitting the multi-channel voice stream multiplexed by the multi-channel multiplexer to a session-connected user terminal;

A multi-channel demultiplexer for receiving a multi-channel voice stream and a listening selection language from the user terminal and extracting digital voice data corresponding to the listening selection language from the received multi-channel voice stream; And

And a multi codec decoder to convert digital voice data extracted by the multi-channel demultiplexer into analog voice.

In one embodiment, the multi codec encoder unit,

An analog voice buffer unit for storing the analog voice output from the microphone of the interpreter; A codec selector for selecting a codec for converting the analog voice into a digital voice among a plurality of pre-stored codecs; A codec processing unit which converts the analog voice of the interpreter into digital voice using the codec selected by the codec selector; And an encoded voice buffer unit in which the converted digital voice is stored.

In one embodiment, the multi-channel multiplexer,

A digital voice buffer storage for storing digital voices processed by the multi codec encoder for each language; A timer setting a period for multiplexing each language voice in a predetermined time unit; A channel selector for selecting each language voice according to the period value set in the timer; A channel multiplexing processor for multiplexing the speech of each channel; And a multi-channel voice stream buffer in which the multiplexed voice is stored.

In one embodiment, the streaming server,

A session manager for managing a connection and session with a user terminal of each user who wants to listen to an interpreted voice; A session connection unit in charge of communicating with the user terminal; And a session buffer unit for transport stream transport for each session.

In one embodiment, the multi-channel demultiplexer,

A channel selector for setting the listening selection language received from the user terminal; A channel extractor for extracting voice data of a channel corresponding to a listening selection language selected by the user from a multi-channel voice stream received from the user terminal; And a voice channel buffer in which the extracted voice data corresponding to the listening selection language is stored.

In one embodiment, the multi codec decoder unit,

A codec processor for decoding data in a specific channel buffer extracted by the multi-channel demultiplexer; A codec selector for decoding codec selection; And an analog voice buffer to store the decoded analog voice.

According to another aspect of the present invention, there is provided a simultaneous interpretation voice transmission method through a simultaneous interpretation voice transmission system.

Simultaneous interpretation voice transmission method according to an embodiment of the present invention,

(a) encoding each analog voice received from a microphone of each interpreter interpreting in a different language into digital voice, respectively;

(b) multiplexing the interpreted speech data of each encoded station;

(c) transmitting the multiplexed multi-channel voice stream to the session-connected user terminal;

(d) demultiplexing the multi-channel voice stream received from the user terminal to extract digital voice data corresponding to the listening selection language selected by the user terminal; And

(e) decoding the extracted digital voice data into analog voice.

In one embodiment, the step (c),

Establishing a connection and session with the user terminal; And

When the data transmission request is received from the user terminal, transmitting the multi-channel voice stream to the user terminal using a connected session.

In one embodiment, the step (d),

Receiving the listening selection language from the user terminal;

Receiving a multi-channel voice stream from the user terminal;

Extracting digital voice data corresponding to the listening selection language based on the received listening selection language and the multi-channel voice stream.

Simultaneous interpretation voice transmission method according to an embodiment of the present invention may further comprise the step of transmitting so that the decoded analog voice can be output through the user terminal.

According to an embodiment of the present invention, the cost of the simultaneous interpreter receiver itself can be listened to by real-time listening to the simultaneous interpreter's voice using a smartphone owned by the individual instead of the simultaneous interpreter receiver provided in the existing simultaneous interpreter environment. It can reduce and eliminate the need to know how to operate different types of simultaneous interpreter receivers. There is also the advantage of free choice of listening language.

In addition, according to an embodiment of the present invention, there is no limit to the number of simultaneous interpretation languages by using a speech muxing and demuxing technique.

In addition, according to an embodiment of the present invention, by applying the codec technology to improve the quality of the analog voice, by selecting and using the encoding and decoding codec quality suitable for the network environment of the conference hall, the optimal voice quality suitable for the conference hall environment Can provide.

In addition, according to an embodiment of the present invention, by providing a low-cost medium / small-scale system and method instead of the existing expensive simultaneous interpretation operating system, it can bring the effect of reducing the simultaneous interpretation system operating costs.

1 is an overall configuration diagram of a system and method for simultaneous interpretation voice transmission using multiple codecs and multiple channels.
2 is a configuration diagram of a multi-codec encoder unit for converting an analog voice of a microphone into a digital voice.
3 is a block diagram of a multi-channel multiplexer for multiplexing interpreted speech for each language into a single transport stream;
4 is a configuration diagram of a streaming server unit for servicing a multiplexed multi-channel voice stream to a smartphone terminal.
5 is a block diagram of multi-channel demultiplexing for extracting only a specific voice to be listened to from a multi-channel voice stream received from a smartphone terminal.
6 is a block diagram of a multi-codec decoder for converting digital voice into analog voice.

The present invention may be variously modified and have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail with reference to the accompanying drawings. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail with reference to the accompanying drawings. In addition, numerals (e.g., first, second, etc.) used in the description of the present invention are merely an identifier for distinguishing one component from another.

Also, in this specification, when an element is referred to as being "connected" or "connected" with another element, the element may be directly connected or directly connected to the other element, It should be understood that, unless an opposite description is present, it may be connected or connected via another element in the middle.

Hereinafter, a multi codec and a multi-channel simultaneous interpretation voice transmission system and method according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

The present invention relates to a method for reducing the installation cost and user convenience of a system for providing simultaneous interpretation service by at least two simultaneous interpreters in a multi-language international conference hall, exhibition hall and seminar. Encoding technology that converts analog voice output to microphone into digital voice, Transport Streaming technology that multiplexes the interpreter's voice into one stream, and extracts only the specific language channel to be listened to from the receiving terminal. Demuxing technology, and decoding technology for converting digital voice back to analog voice and outputting to a speaker are assumed.

[Description of Fig. 1]

1 is an overall configuration diagram of a system and method for simultaneous interpretation voice transmission using multiple codecs and multiple channels.

Referring to FIG. 1, a simultaneous interpretation voice transmission system according to an embodiment of the present invention includes a multi codec encoder 10, a multi channel multiplexer 20, a streaming server 30, and a multi channel demultiplexer 40. And a multi codec decoder 50.

Here, the multi codec encoder unit 10 encodes the analog voice transmitted from the interpreter's microphone into a digital voice, and the multi-channel multiplexer 20 muxes the encoded voice of each interpreter, and the streaming server unit ( 30) service the multiplexed voice stream to a user terminal (e.g., a terminal used by a conference attendee or listener). In addition, the multi-channel demultiplexer 40 extracts only a specific language channel from the voice stream received from the user terminal, and the multi-codec decoder 50 plays a role of converting and outputting the language voice selected by the user to analog.

Hereinafter, the respective components related to the simultaneous interpretation voice transmission system according to an embodiment of the present invention will be described in detail with reference to FIGS. 2 to 6.

2-Description of the multi codec encoder section

2 is a diagram illustrating a configuration of a multi codec encoder for converting an analog voice of a microphone into a digital voice.

According to an embodiment, as shown in FIG. 2, the multi-codec encoder 10 to be applied to the present invention includes an analog voice buffer unit 13, a codec selector 14, a codec processor 16, and an encoded voice. A buffer unit 17 may be included.

Here, the analog voice buffer unit 13 is a voice store in which the analog voice output from the interpreter's microphone is stored, and the codec selector 14 is a codec for converting analog voice into digital voice among various codecs such as MPEG2, AAC, and MP3. It serves to select. Here, the audio codec may be selected by a setting value set by the system administrator. In addition, in the present invention, the audio codec is not limited to the above-described MPEG2, AAC, and MP3, and the audio codec that can be used for encoding the voice signal may be used without any limitation.

The codec processor 16 converts an analog voice of an interpreter into a digital voice using a codec selected according to a codec selector value. Here, the encoded speech buffer unit 17 is a voice store in which the converted digital speech (ie, encoded speech processed by the codec processor 16) is stored.

3-Description of a multi-channel multiplexer

3 is a block diagram of a multi-channel multiplexer for multiplexing interpreted speech for each language into a single transport stream.

In the embodiment of the present invention, the multi-channel multiplexer 20 stores digital data stored through the multi-codec encoder 10 for each language (ie, for each channel) as shown in FIG. 3. Voice buffer storages 21, 22, 23, 24, a timer 26 for multiplexing each language voice on a time basis, a channel selector 25 for selecting each language voice by the timer, and each A channel multiplexing processor 27 for multiplexing channels and a multi-channel transport stream buffer 28 for storing the multiplexed voice may be included.

Here, the digital voice buffer storages 21, 22, 23, and 24 each have a storage for each language, and the encoded digital voice data is stored. The timer 26 has a value for setting a period for multiplexing the speech for each language, and the channel selector 25 extracts a predetermined portion of the speech data for each language according to the timer value. It serves to provide to the multiplexing processing unit 27.

The channel multiplexing processor 27 muxes the voice data input through the channel selector 25 to conform to the transport stream standard, and processes the processed result in the multi-channel voice stream buffer storage 28. Store in Here, the transport stream may follow the MPEG2-TS standard.

4-Description of the streaming server unit

4 is a configuration diagram of a streaming server unit for servicing a multiplexed multi-channel voice stream to a smartphone terminal. In FIG. 4, the multi-channel voice stream buffer 28 is illustrated as existing outside the multi-channel multiplexer 20. However, this is for convenience of description of FIG. 4, and the multi-channel voice stream buffer 28 is illustrated in FIG. 4. As shown in FIG. 3, first, the components present in the multi-channel multiplexer 20 are clarified.

Here, the streaming server 30 is connected to the streaming server 30, the voice data in the multi-channel voice stream buffer 28 processed by the multi-channel multiplexer 20, each smartphone terminal 35 (for example It may be a smart phone terminal used by the meeting attendees or listeners). As described above, in the present specification, for convenience of description, the case of the smartphone terminal will be described, but the user terminal used by the conference attendee or the listener is not necessarily limited to the smartphone. Hereinafter, a configuration example of the streaming server 30 will be described in detail.

In the embodiment of the present invention, the streaming server unit 30, as shown in Figure 4, the session manager 31 for managing the connection and session of each smartphone terminal, and the session to be in communication with the smartphone terminal The connection unit 32 may include a session buffer unit 33 for transporting a transport stream for each session.

Here, the session manager 31 checks whether the smartphone terminal is connected, and allocates a new session to the terminal when the connection is made. In addition, the session manager 31 assigns the session connection part 32 the data communication role with a smartphone terminal, and continues checking the connection of a smartphone terminal again.

In addition, the session connection unit 32 is responsible for the actual data communication with the session connection unit 34 of the smart phone terminal 35, and the voice in the multi-channel stream buffer 28 at the time of the data request from the terminal session connection unit 34. The data is copied to the session buffer 33 and transmitted to the terminal, and the session connection unit 34 of the terminal stores the received voice data in the reception buffer 35 of the terminal.

That is, in the embodiment of the present invention, the streaming server 30, when the data request from the session-connected smartphone terminal 35 side, the voice stored in the multi-channel voice stream buffer 28 of the multi-channel multiplexer 20 It serves to transmit the stream to the smart phone terminal 35 for the data request.

5-Description of the multi-channel demultiplexer

5 is a block diagram of a multi-channel demultiplexer for extracting only a specific voice to be listened to from a multi-channel voice stream received from a smart phone terminal.

In the embodiment of the present invention, the multi-channel demultiplexer 40, as shown in Figure 5, the channel selector 41 that can set the language that the user wants to listen to, and the channel selected by the user in the multi-channel voice stream And a channel extractor 42 for extracting only the voice data of the portion, and a voice channel buffer 43, 44, 45, 46 in which the extracted specific voice language is to be stored.

In this case, the channel selection may be performed by a method in which the channel input value is set in the channel selector 41 when the smartphone user selects a specific language to be listened to through an application program. In this case, the channel extractor 42 extracts only the voice language set in the terminal reception buffer 35 with reference to the value set in the channel selector 41 and stores the voice language in the voice channel buffers 43, 44, 45, and 46.

That is, in the embodiment of the present invention, the multi-channel demultiplexer 40 receives the multi-channel voice stream and the channel input (that is, language selection) stored in the terminal reception buffer from the smartphone terminal 35. In this case, the multi-channel voice stream is demultiplexed based on a language (ie, a channel) input (selected) by the user.

6-Description of the Multi Codec Decoder

6 is a block diagram of a multi-codec decoder for converting digital voice to analog voice.

In the embodiment of the present invention, as shown in FIG. 6, the multi-codec decoder 50 may include a codec processor 51 for decoding data in a specific channel buffer extracted by the multi-channel demultiplexer 40. A codec selector 53 for decoding codec selection may include an analog voice buffer 54 for storing the decoded analog voice.

Here, the codec selector 53 checks codec information in the voice channel buffers 43, 44, 45, and 46 to set the corresponding codec, and the codec processor 51 decodes the voice channel language using the set codec. Then, it is stored in the analog voice buffer 54 so that the voice is output to the speaker.

That is, in the exemplary embodiment of the present invention, the multi codec decoder 50 may convert language speech data stored in each voice channel buffer 43, 44, 45, 46 of the multi-channel demultiplexer 40 to a corresponding codec ( In other words, the audio codec corresponding to the audio codec when the speech signal of the corresponding language is encoded in advance is decoded. Therefore, the multi-codec encoder unit 50 restores the analog voice (ie, the voice of the original interpreter) for each channel (ie, language). The restored analog voice may be output through the speaker of the smartphone terminal of the user who selects the corresponding channel for each channel.

The simultaneous interpretation and voice transmission system and method using the multi-codec and the multi-channel according to the present invention are not limited to the above-described embodiments and can be modified in various ways within the scope of the technical idea of the present invention. That is, while the above has been described with reference to the embodiments of the present invention, those skilled in the art may vary the present invention without departing from the spirit and scope of the present invention as set forth in the claims below. It will be easy to understand that it can be modified and changed.

Claims (10)

A multi-codec encoder unit for converting an analog voice received from an interpreter's microphone into a digital voice;
A multi-channel multiplexer which multiplexes the multilingual interpreted voice data processed by the multi-codec encoder;
A streaming server transmitting the multi-channel voice stream multiplexed by the multi-channel multiplexer to a session-connected user terminal;
A multi-channel demultiplexer for receiving a multi-channel voice stream and a listening selection language from the user terminal and extracting digital voice data corresponding to the listening selection language from the received multi-channel voice stream; And
A multi codec decoder configured to convert digital voice data extracted by the multi-channel demultiplexer into analog voice,
The multi-channel multiplexer,
A digital voice buffer storage for storing digital voices processed by the multi codec encoder for each language;
A timer setting a period for multiplexing each language voice in a predetermined time unit;
A channel selector for selecting each language voice according to the period value set in the timer;
A channel multiplexing processor for multiplexing the speech of each channel; And
Multi-channel voice stream buffer unit for storing the multiplexed voice
Simultaneous interpretation voice transmission system comprising a.
The method of claim 1,
The multi codec encoder unit,
An analog voice buffer unit for storing the analog voice output from the microphone of the interpreter;
A codec selector for selecting a codec for converting the analog voice into a digital voice among a plurality of pre-stored codecs;
A codec processing unit which converts the analog voice of the interpreter into digital voice using the codec selected by the codec selector; And
Encoding voice buffer unit for storing the converted digital voice
Simultaneous interpretation voice transmission system comprising a.
delete The method of claim 1,
The streaming server,
A session manager for managing a connection and session with a user terminal of each user who wants to listen to an interpreted voice;
A session connection unit in charge of communicating with the user terminal; And
Session buffer unit for transport stream for each session
Simultaneous interpretation voice transmission system comprising a.
The method of claim 1,
The multi-channel demultiplexer,
A channel selector for setting the listening selection language received from the user terminal;
A channel extractor for extracting voice data of a channel corresponding to a listening selection language selected by the user from a multi-channel voice stream received from the user terminal; And
Voice channel buffer for storing extracted voice data corresponding to the listening selection language
Simultaneous interpretation voice transmission system comprising a.
The method of claim 1,
The multi codec decoder unit,
A codec processor for decoding data in a specific channel buffer extracted by the multi-channel demultiplexer;
A codec selector for decoding codec selection; And
Analog voice buffer to store decoded analog voice
Simultaneous interpretation voice transmission system comprising a.
delete delete delete delete

Images