JPH06217299A - Visual telephone device - Google Patents

Abstract

(57) [Summary] [Purpose] To provide a character communication function and a pointing function without adding enormous hardware and software. [Structure] The multiplexing control unit 31 sends moving image data, audio data, and terminal data to CCITT Recommendation H.264. 221 is multiplexed in a predetermined frame format, and the multiplexed frame sent from the partner device is separated into moving image data, voice data, and terminal data, and BAS (bit rate) indicating the start and end of character communication is further separated. The transmission / reception of terminal data is controlled by the assigned signal) code. Further, the character communication control unit 30 displays the terminal data received from the data terminal 24 and the other party's device on the monitor device 23 at the time of the character communication, and in the case of pointing, the data terminal 24 and the other party's terminal beforehand. The respective specific characters indicating the defined upward, downward, left, and right movements are detected, and the pointing display is moved upward, downward, left, and right at regular intervals.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a videophone device having a function of multiplexing moving image data, voice data and terminal data.

[0002]

2. Description of the Related Art In recent years, CCITT (International Telegraph and Telephone Advisory Committee) has officially made a recommendation of a video coding system, a multiplexing system, and a communication procedure for audiovisual services, and televisions complying with CCITT recommendation from each company. Devices such as conference systems and video phones have been put on the market.

A conventional videophone device will be described below with reference to the drawings. FIG. 3 is a functional block diagram of a conventional videophone device. In FIG. 3, reference numeral 1 is used for a telephone handset, camera 2 is used for taking a self-portrait, and monitor device 3 is used for displaying an image from the partner device or a self-portrait. Further, the data terminal 4 is for performing terminal processing by performing file transfer, data communication, etc., and the keypad 5 performs dial input etc. at the time of making a call. further,
The audio control unit 6 connected to the handset 1 encodes and decodes audio data, and the moving image control unit 7 connected to the camera 2 is connected to the monitor device 3 and encodes and decodes moving image data. And the display control of the image on the monitor device 3. Further, the terminal control unit 8 to which the data terminal 4 is connected controls data transmission and reception with the data terminal 4. Further, the key control unit 9 to which the keypad 5 is connected has the keypad 5 pressed by the user.
Detect the key type of.

The multiplexing control unit 10 to which the audio control unit 6, the moving image control unit 7, and the terminal control unit 8 are connected, receives the moving image data, the audio data, and the terminal data from CCITT Recommendation H.264. 221 (In audiovisual teleservice
A frame structure of 64 kbit / s to a frame structure of 1920 kbit / s) is multiplexed in a predetermined frame format, and H.264 transmitted from the partner device. 221 frames are separated into moving image data, audio data and terminal data,
Furthermore, CCITT Recommendation H.264. The communication procedure is based on 242 (a method for setting communication between audiovisual terminals using digital channels up to 1920 kbit / s).
S (bit rate allocation signal) transmission control and reception control are performed. The network control unit 11 to which the multiplexing control unit 10 is connected is connected to the communication network 12 and controls the connection to the communication network 12.

FIG. 4 shows CCITT Recommendation H.264. 221 shows the multiplexing frame structure specified in 221. In FIG. 4, rows 1 to 8 are bit numbers and columns 1 to 80 are octet numbers. FAS is a frame synchronization signal, B
AS is a bit rate allocation signal.

5 and 6 show CCITT Recommendation H.264. 221
2 shows a numerical table of BAS code defined in. Figure
5 and FIG. 6, the column headings are bit (b₀，
b₁, B ₂) Type attribute, and the leftmost column is a bit
To (b₃, B_Four, B_Five, B₆, B ₇) Shows the value of
It

With the above configuration, the operation will be described below. First, the network control unit 11 controls the connection of the communication channel with the partner device via the communication network 12. After the connection is completed, the H.264 signal is transmitted by the multiplexing control unit 10 via the communication channel. A mode initialization procedure based on 242 is activated. In this mode initialization procedure, first, synchronization is established by controlling the FAS (frame synchronization signal) in the multiplexed frame as shown in FIG. 4, and after this synchronization is established, the BAS shown in FIG.
By setting the audio / transfer rate capability and the data / video capability of the BAS code shown in FIG. 5 at the position, the capabilities are exchanged with the partner device and the capabilities of the own device and the partner device are exchanged. In consideration of the above, the command BAS code is used to switch to an appropriate operation mode. Thereafter, the voice control unit 6, the moving image control unit 7, and the terminal control unit 8 multiplex the voice data, the moving image data, and the terminal data with the multiplexing control unit 10, and send them to the communication network 12 via the network control unit 11. When the multiplexed data from the other party's device is received by the multiplexed control unit 10 via the network control unit 11, the audio control unit 6, after separating the audio data, the moving image data and the terminal data, It is transferred to the moving image control unit 7 and the terminal control unit 8 and output to the handset 1, the monitor device 3 and the data terminal 4.

[0008]

However, in the above-mentioned conventional configuration, when the character communication function and the pointing function are installed, it is necessary to connect an external liquid crystal tablet or the like to support applications such as handwriting recognition by software and pointing function. Therefore, there is a problem that both hardware and software increase significantly.

The present invention solves the above-mentioned conventional problems, and an object of the present invention is to provide a videophone device which can be equipped with a character communication function and a pointing function without adding enormous hardware and software. To do.

[0010]

In order to solve the above problems, a videophone device of the present invention is a videophone device for multiplex-transmitting moving image data, voice data and terminal data, wherein the moving image data, voice Data and terminal data are multiplexed in a predetermined frame format, and the moving image data, voice data, and terminal data are separated from the multiplexed frame sent from the partner device, and further,
A multiplexing control unit for controlling transmission / reception of terminal data by a BAS (bit rate allocation signal) code indicating the start and end of character communication; and terminal data received from a data terminal when the character communication key is pressed, The terminal data received from the partner device when the BAS code indicating the start of character communication is detected by the multiplexing control unit. And a character communication control unit for controlling to display on the monitor device while transferring to the data terminal.

Further, the video telephone device of the present invention is a video telephone device for multiplex transmission of moving image data, voice data and terminal data, wherein the moving image data, voice data and terminal data are multiplexed in a predetermined frame format. Further, multiplexing for separating the moving image data, voice data and terminal data from the multiplexed frame sent from the partner device, and for controlling transmission / reception of terminal data by a BAS code indicating start and end of pointing When the control unit and the pointing key are pressed, a self-sided pointing display is displayed on the monitor device, and a predetermined interval is thereafter received when each specific character indicating a predetermined upward, downward, leftward, or rightward movement is received from the data terminal. Above,
The BAS is controlled so as to move the own pointing display to the bottom, left, and right, and also indicates the start of pointing.
When the code is detected by the multiplexing control unit, a partner pointing display is displayed on the monitor device, and thereafter, specific character data indicating predetermined upward, downward, left, and right movements is received from the partner device. Then it goes up at regular intervals,
It is provided with a character communication control unit that controls to move the pointing display on the other side to the bottom, left, and right.

[0012]

With the above construction, when the character communication key is pressed in the character communication control unit, the terminal data received from the data terminal is transferred to the multiplexing control unit and displayed on the monitor device. Then, when the BAS code from the partner device indicating the start of character communication is detected by the multiplexing control unit, the terminal data received from the partner device is transferred to the data terminal and displayed on the monitor device. In addition, when the pointing key is pressed, the monitor device is controlled to perform the pointing display on its own side, and thereafter, the respective specific characters indicating upward, downward, left, and right movements which are predetermined are displayed on the data terminal. When it receives more, it moves the own pointing display up, down, left, and right at regular intervals, and the BAS code from the partner device indicating the start of pointing is displayed. When it is detected by the duplication control unit, control is performed so as to perform pointing display on the partner side on the monitor device, and thereafter, specific character data indicating predetermined upward, downward, left, and right movements is transmitted from the partner device. When receiving, it controls to move the other party's pointing display at regular intervals, so by using a data terminal used for file transfer or data communication without adding enormous hardware and software, A videophone device equipped with a communication function and a pointing function can be obtained.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a functional block diagram of a videophone device according to an embodiment of the present invention. In FIG.
Reference numeral 21 is used for a telephone handset, camera 22 is used for capturing a self-portrait, and monitor device 23 is used for displaying an image from the partner device or a self-portrait. Further, the data terminal 24 is for performing terminal processing by performing file transfer and data communication, and the key pad 25 is a key input to start dial input and character communication at the time of calling, end and start pointing. The user gives instructions such as termination. Further, the voice control unit 26 to which the handset 21 is connected performs encoding and decoding of voice data. Furthermore, the moving image control unit 27 to which the camera 22 is connected is connected to the monitor device 23, performs encoding and decoding of moving image data, and controls display of an image on the monitor device 23. In addition, the data terminal 24
The terminal control unit 28 to which is connected performs data transmission control and reception control with the data terminal 24. Furthermore, the key control unit 29 to which the keypad 25 is connected is the keypad that the user has pressed.
Detects 25 key types.

The character communication control unit 30 to which the terminal control unit 28 and the key control unit 29 are connected is connected to the monitor device 23 and the multiplexing control unit 31, and when the character communication key of the keypad 25 is pressed. Controls the terminal data received from the data terminal 24 to be transferred to the multiplexing control unit 31 and displayed on the monitor device 23. Further, the character communication control unit 30 transfers the terminal data received from the partner device to the data terminal when the BAS code from the partner device expanded to start the character communication is detected by the multiplexing controller 31. The display is controlled to be displayed on the monitor device 23.
Furthermore, when the pointing key of the keypad 25 is pressed, the character communication control unit 30 controls the monitor device 23 to display its own side pointing display, and thereafter, predetermined upper, lower, left, and right When each specific character indicating movement is received from the data terminal 24, it rises at a constant interval,
Control is performed to move the own side pointing display to the bottom, left and right, and when the BAS code from the extended partner side device indicating the start of pointing is detected by the multiplexing control unit 31, the monitor device 23 is displayed. It controls to perform pointing display on the opponent side, and thereafter, when receiving specific character data indicating predetermined upward, downward, left, and right movements from the opponent's device, it moves up, down, left, and right at regular intervals. Control to move the pointing display of the other party.

Further, these audio control unit 26 and moving image control unit
Multiplexing control unit 31 to which 27 and character communication control unit 30 are connected
Is connected to the network control unit 33 for connecting to the communication network 32,
CCIT video data, audio data and terminal data
Recommendation H.T. 221 is multiplexed in a predetermined frame format, and the multiplexed frame sent from the other device is separated into moving image data, audio data and terminal data, and further CCITT Recommendation H.264. BA based on communication procedure based on 242
S transmission control and reception control are performed.

The operation of the above arrangement will be described below. First, when starting character communication, it is necessary to confirm that the user pressed the character communication key of the keypad 25.
When it is detected by 29, the character communication key press notification is transmitted to the character communication control unit 30. In the character communication control unit 30, a character communication start instruction is transmitted to the multiplexing control unit 31, and the received data from the data terminal 24 transferred via the terminal control unit 28 is transferred to the multiplexing control unit 31 and is also monitored. Display control to the device 23 is performed. Here, the extended BAS code table is shown in FIG. 2, but the attribute “(110)” not used in the BAS code table shown in FIGS. 5 and 6 has the content shown in FIG.
[0] to [31] "are allocated. In the multiplexing control unit 31 which has received the character communication start instruction, the expanded BAS code of" character communication start "is transmitted to the network control unit 33 and the communication network.
Transmission to the other device via 32.

In addition, when the multiplexing control section 31 detects the extended BAS code of "start of character communication" from the partner device, it transmits a character communication start notification to the character communication control section 30. The character communication control unit 30 transfers the terminal data from the partner device to the terminal control unit 28 and controls the display on the monitor device 23.

Next, when the pointing is started, when the key control unit 29 detects that the user has pressed the pointing key of the keypad 25, the pointing key press notification is transmitted to the character communication control unit 30. The character communication control unit 30 transmits the pointing start instruction to the multiplexing control unit 31 and controls the monitor device 23 to display the own side pointing display. Of the received data from the data terminal 24 transferred through the terminal control unit 28 thereafter, predetermined specific characters indicating upward, downward, leftward, and rightward movements are detected. Control is performed to move the own pointing display to the bottom, left, and right.
The multiplexing control unit 31 that has received this pointing start instruction
Then, the expanded B of "start pointing" shown in FIG.
The AS code is transmitted to the partner device via the network control unit 33 and the communication network 32.

Further, when the multiplexing control unit 31 detects the BAS code from the partner device to which the "pointing start" is extended, it transmits a pointing start notification to the character communication control unit 30. In the character communication control unit 30, the monitor device
It is controlled so as to perform pointing display on the partner side to 23, and among the terminal data of the partner side device transferred thereafter via the multiplexing control unit 31, predetermined upward, downward, left, and right movements are performed. When each of the specific characters shown is detected, control is performed so as to move the opponent pointing display up, down, left, and right at regular intervals.

Further, the case where the character communication ends and the pointing ends will be described. When the key control unit 29 detects that the character communication key or the pointing key is pressed again after the character communication starts or the pointing starts, the character communication key press notification or the pointing key press notification is transmitted to the character communication control unit 30. Character communication control unit
At 30, after transmitting the character communication end instruction or the pointing end instruction to the multiplexing control unit 31, after deleting the character or pointing display displayed on the monitor device 23,
Received data from the data terminal 24 transferred via the terminal control unit 28 is transferred to the multiplexing control unit 31. Upon receiving the character communication end instruction or the pointing end instruction, the multiplexing control unit 31 transmits the extended BAS code of “character communication end” or “pointing end” shown in FIG. 2 via the network control unit 33 and the communication network 32. Transmit to the other device.

When the multiplexing control unit 31 detects the BAS code from the partner device to which the "character communication end instruction" or the "pointing end instruction" is extended, the character communication control unit 30 is notified of the end of character communication or Transmit a pointing end notification. In the character communication control unit 30, the monitor device 23
After controlling to erase the character or the pointing display displayed on the terminal device, the terminal data of the other party's device transferred via the multiplexing control unit 31 from now on is transmitted to the terminal control unit 28.
And is output to the data terminal 24 via the terminal control unit 28.

[0022]

As described above, according to the present invention, by using the data terminal used for file transfer and data communication, the character communication function and the pointing function can be achieved without adding a huge amount of hardware and software. It is possible to provide a videophone device equipped with.

[Brief description of drawings]

FIG. 1 is a functional block diagram of a videophone device according to an embodiment of the present invention.

FIG. 2 is an expanded BAS in the videophone device of FIG.
Code table of

FIG. 3 is a functional block diagram of a conventional videophone device.

FIG. 4 CCITT Recommendation H. 221 Multiplex frame structure diagram specified in 221

FIG. 5: CCITT Recommendation H. BA defined in 221
S code table (Part 1)

FIG. 6 CCITT Recommendation H.264. BA defined in 221
S code table (Part 2)

[Explanation of symbols]

 23 Monitor device 24 Data terminal 25 Keypad 28 Terminal control unit 29 Key control unit 30 Character communication control unit 31 Multiplexing control unit

Claims (2)

[Claims] 1. A video telephone device for multiplex-transmitting moving image data, voice data and terminal data, wherein the moving image data, voice data and terminal data are multiplexed in a predetermined frame format and transmitted from a partner device. A multiplexing control for separating the moving image data, the audio data, and the terminal data from the received multiplexed frame, and controlling transmission / reception of the terminal data by a BAS (bit rate allocation signal) code indicating the start and end of the character communication. And a control unit for transferring terminal data received from a data terminal when the character communication key is pressed to the multiplexing control unit and displaying on a monitor device, and for indicating the start of character communication. Transfers the terminal data received from the partner device when the BAS code is detected by the multiplexing control unit to the data terminal. Videophone apparatus and a character communication control unit for controlling to perform display on the monitor device with. 2. A videophone device for multiplex-transmitting moving image data, voice data and terminal data, wherein the moving image data, voice data and terminal data are multiplexed in a predetermined frame format and sent from a partner device. A multiplexing control unit that separates the moving image data, the audio data, and the terminal data from the received multiplexed frame, and that controls the transmission and reception of the terminal data by the BAS code that indicates the start and end of pointing, and the pointing key is pressed. When a specific character indicating a predetermined upward, downward, leftward, or rightward movement is received from the data terminal, a predetermined pointing character is displayed on the monitor device at a fixed interval. The BAS that controls the movement of the pointing display on its own side and indicates the start of pointing. When the number is detected by the multiplexing control unit, the other party's pointing display is displayed on the monitor device, and thereafter, specific character data indicating predetermined upward, downward, left, and right movements is received from the other party's device. Then, the videophone device is provided with a character communication control unit that controls to move the pointing display of the other party up, down, left, and right at regular intervals.