KR102014769B1 - Apparatus for using face recognition information and method thereof - Google Patents

Abstract

An apparatus for providing a service interworking a playback device may include: an information receiver configured to receive first face recognition information from a TV playback device and to receive second face recognition information from a mobile playback device, the received first face recognition information and a second face recognition; A face recognition information comparator for comparing information, an interlocking unit for interlocking the TV player and the mobile player when the received first face recognition information and the second face recognition information are matched, and contents to the TV player; It provides a service, and a service providing unit for providing an additional service corresponding to the content to the mobile playback device.

Description

Apparatus and method using face recognition information {APPARATUS FOR USING FACE RECOGNITION INFORMATION AND METHOD THEREOF}

A device and method for providing an additional service to a playback device interoperating with another playback device using face recognition information.

With the development of information and communication technology, many kinds of high performance playback devices have been developed. For example, an IPTV that provides broadcast content and VOD content and provides interactive services with a user is developed, and a smart phone capable of transmitting and receiving data as a mobile terminal and executing various applications. In addition, there is a smart pad that has a similar size to a smart phone and reduced call function.

As various playback devices are developed to meet the user's preferences, users own multiple playback devices, and with the development of N-screen technology, various services can be provided using IPTV and smart phones.

Korean Laid-Open Patent Publication No. 2009-0127534 discloses a configuration for displaying a list reflecting personality such as displaying a personal favorite channel list and displaying a recommended channel list by recognizing a face of a user through a camera attached to an IPTV.

An apparatus and method for providing an additional service to a playback device interoperating with another playback device using face recognition information are provided. However, the technical problem to be achieved by the present embodiment is not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, the service providing device for interlocking the playback device according to the first aspect of the present invention receives the first face recognition information from the TV playback device, the second face recognition from the mobile playback device An information receiving unit receiving information, a face recognition information comparing unit comparing the received first face recognition information and second face recognition information, and when the received first face recognition information and the second face recognition information are matched, And a service providing unit for providing a content service to the TV playback device and an interworking unit for interlocking a TV playback device and the mobile playback device, and providing an additional service corresponding to the content to the mobile playback device.

On the other hand, a method for interlocking a playback device according to a second aspect of the present invention comprises the steps of receiving first face recognition information from a TV playback device, receiving second face recognition information from a mobile playback device, the received first Comparing the face recognition information with the second face recognition information, and when the received first face recognition information and the second face recognition information are matched, interlocking the TV playback device and the mobile playback device, and playing the TV. Providing a content service to a device and Providing an additional service corresponding to the content to the mobile playback device.

On the other hand, the mobile playback device linked with the TV playback apparatus according to the third aspect of the present invention is an information input unit for receiving face recognition information, an information transmitter for transmitting the received face recognition information to the service providing device, the service providing device And a supplementary service receiving unit receiving an additional service from the service providing apparatus by an interworking unit interworking with the TV playing apparatus, wherein the received supplementary service corresponds to the content played in the linked TV playing apparatus, The transmitted face recognition information may be used to determine whether the service providing device is linked with the TV playback device.

On the other hand, the method according to the fourth aspect of the present invention, the mobile playback device interlocks with the TV playback device, receiving face recognition information, transmitting the received face recognition information to the service providing device, the service providing device Interworking with the TV playback device and receiving an additional service from the service providing device, wherein the received additional service corresponds to content played by the linked TV playback device, and recognizes the transmitted face. The information may be used by the service providing device to determine whether to interwork with the TV playback device.

According to any one of the above-described problem solving means of the present invention, since the service providing apparatus interlocks the playback apparatus only with face recognition information, it is possible to achieve user convenience such as interworking the playback apparatus without inputting personal information.

1 is a block diagram of a playback device interworking system according to an embodiment of the present invention.
2 is a block diagram of a service providing apparatus shown in FIG. 1 according to an embodiment of the present invention.
3 is a block diagram of a mobile playback device shown in FIG. 1 according to another embodiment of the present invention.
4 is a flowchart illustrating a method of interlocking a playback device by a service providing device according to an embodiment of the present invention.
5 is a flowchart illustrating a method of interworking with a TV playback device by a mobile playback device according to an embodiment of the present invention.
6 is a block diagram of a playback device interworking system in the case of multiple users of the TV playback device according to an embodiment of the present invention.
7 is a configuration diagram of a playback device interworking system when there is only one user of a TV playback device according to another embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Throughout the specification, when a part is "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element in between. . In addition, when a part is said to "include" a certain component, which means that it may further include other components, except to exclude other components unless otherwise stated.

Hereinafter, with reference to the accompanying configuration diagram or processing flow chart, it will be described in detail for the practice of the present invention.

1 is a block diagram of a playback device interworking system according to an embodiment of the present invention. Referring to FIG. 1, the playback device interworking system may include a TV playback device 100, a mobile playback device 200, a service providing device 300, a pairing server 400, and a network. However, since the playback device interworking system of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1.

The TV playback apparatus 100 may receive a content service from the service providing apparatus 300. That is, the TV playback apparatus 100 may receive content that the user wants to watch from the service providing apparatus 300.

The TV playback apparatus 100 may receive face recognition information of the user using a camera connected to the TV playback apparatus 100 and transmit the received face recognition information to the service providing apparatus 300. In this case, when the transmitted face recognition information is appropriate, the TV playback apparatus 100 may be linked with the mobile playback apparatus 200 from the service providing apparatus 300 through the pairing server 400. The TV playback apparatus 100 may be linked with one mobile playback device or may be linked with several mobile playback devices.

If there is only one user of the TV playback apparatus 100 according to another embodiment of the present invention, the TV playback apparatus 100 corresponds to the content to be played or played back in the TV playback apparatus 100 from the service providing apparatus 300. Additional services may be provided.

The at least one mobile playback device 200 may receive a face recognition information of the user using a camera connected to the mobile playback device 200 and transmit the received face recognition information to the service providing device 300. At this time, if the transmitted face recognition information is appropriate, the mobile playback apparatus 200 may be linked with the TV playback apparatus 100 from the service providing apparatus 300 through the pairing server 400.

In addition, when the mobile reproducing apparatus 200 is interlocked with the TV reproducing apparatus 100, the mobile reproducing apparatus 200 corresponds to the content to be reproduced or to be reproduced in the TV reproducing apparatus 100 from the service providing apparatus 300. Additional services may be provided. In this case, when there are a plurality of mobile playback devices 200 interoperating with the TV playback device 100, the additional services provided by the plurality of mobile playback devices 200 may be different.

The service providing apparatus 300 may receive face recognition information of the user of the TV playback apparatus 100 from the TV playback apparatus 100, and recognize the face of the user of the mobile playback apparatus 200 from the mobile playback apparatus 200. Information can be received.

When there is one user of the TV playback apparatus 100 according to another embodiment of the present invention, the service providing apparatus 300 does not receive face recognition information from the mobile playback apparatus 200 of the user of the TV playback apparatus 100. By receiving the face recognition information of the user of the TV playback apparatus 100 from the TV playback apparatus 100, the user of the TV playback apparatus 100 is identified as a legitimate user, and the TV playback apparatus 100 is provided to the TV playback apparatus 100. ) May provide an additional service corresponding to the content to be reproduced or to be reproduced.

When the face recognition information of the user of the TV playback apparatus 100 and the face recognition information of the user of the mobile playback apparatus 200 are matched with each other, the service providing apparatus 300 may match the TV playback apparatus 100 and the mobile playback apparatus 200. ) May be linked through the pairing server 400.

The service providing apparatus 300 may provide content desired by a user of the TV playback apparatus 100 to the TV playback apparatus 100, and the TV playback apparatus 100 and the mobile playback apparatus 200 interoperate with each other. The service providing apparatus 300 may provide an additional service corresponding to the content to the mobile playback apparatus 200. In this case, the additional service may be provided by transmitting an application program corresponding to the content, transmitting a URL address, or operating an application program pre-installed in the mobile playback apparatus 200.

Hereinafter, a case in which the number of users of the TV reproducing apparatus 100 is one or more will be described with reference to FIGS. 6 and 7.

6 is a block diagram of a playback device interworking system when there are several users of the TV playback device 100 according to an embodiment of the present invention. Referring to FIG. 6, the TV playback apparatus 100 transmits face recognition information of users of the TV playback apparatus 100 to the service providing apparatus 300, and each of the plurality of mobile playback apparatuses 200 recognizes a user's face. Information may be transmitted to the service providing apparatus 300.

The service providing apparatus 300 compares the face recognition information received from the TV playback apparatus 100 with the face recognition information received from each of the plurality of mobile playback apparatuses 200, thereby reproducing the TV playback apparatus 100 and the plurality of mobile playbacks. It may be determined whether or not each device 200 is interlocked.

In addition, when the number of users included in the face recognition information received from the TV playback apparatus 100 and the number of face recognition information received from each of the mobile playback apparatus 200 are different, that is, the user of the TV playback apparatus 100 When the number of people is four and the face recognition information is received from the three mobile playback apparatuses 200, the service providing apparatus 300 may only recognize the face recognition information received from the three mobile playback apparatuses 200 from the TV playback apparatus 100. It may be compared with the received face recognition information. This is because not all users of the TV playback apparatus 100 possess the mobile playback apparatus.

7 is a block diagram of a playback device interworking system in the case where there is only one user of the TV playback device 100 according to another embodiment of the present invention. Referring to FIG. 7, the TV playback apparatus 100 may transmit face recognition information of the user of the TV playback apparatus 100 to the service providing apparatus 300. If the service providing device 300 determines that there is only one user displayed in the face recognition information received from the TV playing device 100, the service providing device 300 determines that the user of the TV playing device 100 is the user. If it is determined that the user is a legitimate user, the TV player 100 may provide an additional service.

Alternatively, the service providing apparatus 300 compares the face recognition information received from the TV playback apparatus 100 with the face recognition information received from the first mobile playback apparatus 201 to reproduce the first mobile playback with the TV playback apparatus 100. It may be determined whether the device 201 is interlocked. If the service providing apparatus 300 determines that the TV playback apparatus 100 and the first mobile playback apparatus 201 interoperate with each other, the service providing apparatus 300 may be the TV playback apparatus 100 or the first mobile playback apparatus. Additional services may be provided to 201.

The pairing server 400 may interlock the TV playback device 100 and the mobile playback device 200 according to a request of the service providing device 300. In more detail, the pairing server 400 may connect a session between the TV playback apparatus 100 and the mobile playback apparatus 200. In addition, the pairing server 400 may maintain the session until there is a separate user input for terminating the session.

According to various embodiments of the present disclosure, the TV playback apparatus 100 and the mobile playback apparatus 200 may have various forms. For example, the TV reproducing apparatus 100 and the mobile reproducing apparatus 200 may be a TV apparatus, a computer, or a portable terminal capable of connecting to a remote server through a network. Here, an example of a TV device includes a smart TV, an IPTV set-top box, and the like, and an example of a computer includes a laptop, desktop, laptop, etc., which is equipped with a web browser. An example of a terminal is a wireless communication device that guarantees portability and mobility, and includes a personal communication system (PCS), a global system for mobile communications (GSM), a personal digital cellular (PDC), a personal handyphone system (PHS), and a personal digital (PDA). Assistant (IMT), International Mobile Telecommunication (IMT) -2000, Code Division Multiple Access (CDMA) -2000, W-Code Division Multiple Access (W-CDMA), Wireless Broadband Internet (Wibro) terminal, smartphone, tablet PC All kinds of handheld based wireless communication devices such as the like may be included.

A network refers to a connection structure capable of exchanging information between nodes such as terminals and servers. Examples of such a network include the Internet, a wireless local area network (WLAN), and a WAN (WAN). Wide Area Network (PAN), Personal Area Network (PAN), 3G, Long Term Evolution (LTE), Wireless Fidelity (WiFi), World Interoperability for Microwave Access (WiMAX), Wireless Gigabit (WiGig), etc. .

The service for interfacing the TV playback apparatus 100 and the mobile playback apparatus 200 using the face recognition information may be provided through an application installed in the TV playback apparatus 100 and / or the mobile playback apparatus 200. . Here, the application means an application, and may include, for example, an app running on a mobile terminal (smartphone).

Hereinafter, the operation of the service providing apparatus 300 of FIG. 1 will be described in more detail.

2 is a block diagram of the service providing apparatus 300 shown in FIG. 1 according to an embodiment of the present invention. Referring to FIG. 2, the service providing apparatus 300 may include an information receiver 310, a face recognition information comparator 320, an interlocking unit 330, a service providing unit 340, and a DB 390. . However, the apparatus 300 for providing a service shown in FIG. 2 is just one implementation example of the present invention, and various modifications may be made based on the elements shown in FIG. 2. For example, the service providing apparatus 300 may further include a user interface for receiving a certain command or information from a user. In this case, the user interface may generally be an input device such as a keyboard, a mouse, or the like, or may be a graphical user interface (GUI) expressed on the image display device.

The information receiver 310 may receive first face recognition information from the TV playback apparatus 100 and receive second face recognition information from the mobile playback apparatus 200.

The information receiver 310 may further receive user information from the TV playback apparatus 100 or the mobile playback apparatus 200. In this case, the user information may include information such as gender, age, hobby, occupation, interest information, and the like of the user.

The face recognition information comparison unit 320 may compare the first face recognition information and the second face recognition information received by the information receiving unit 310. When the first face recognition information and the second face recognition information received by the information receiving unit 310 match, the face recognition information comparing unit 320 matches the TV playback device 100 and the mobile playback device 200 to a suitable user. Can be authenticated, and the restriction set on the TV playback apparatus 100 by the authentication, for example, age restriction for watching an adult movie, and the like can be released.

When the first face recognition information and the second face recognition information received by the information receiver 310 match, the companion unit 330 may interwork the TV playback apparatus 100 and the mobile playback apparatus 200.

The service provider 340 may provide a content service to the TV playback apparatus 100 and may provide an additional service corresponding to the content to the mobile playback apparatus 200. In this case, the additional service may be provided to the mobile playback apparatus 200 only when the TV playback apparatus 100 and the mobile playback apparatus 200 are linked to each other.

The additional service transmits an application corresponding to the content being played or to be played on the TV playback apparatus 100 to the mobile playback apparatus 200, or transmits a URL address to the mobile playback apparatus 200, or the mobile playback apparatus 200. ) May be provided in such a manner as to transmit a signal for activating an application installed in the mobile play device 200. In this case, the transmitted application may be a web application, and in the case of an application requiring download, the application may be installed on the mobile playback device 200 after receiving the approval of the download from the mobile playback device 200. It can be executed automatically or manually.

The additional service may be various kinds of services. The supplementary service may be a broadcast supplementary information providing service including information about a performer appearing in content, an article related to an object, information related to an object such as a background, music, and the like. At this time, the background may be a photographic place, a historic place, a restaurant, a summer resort, and the like. In addition, the additional service may be a search service that provides a web search result related to the content, or may be an SNS service that exchanges opinions corresponding to the content or provides postings of others on a social network.

The additional service may be determined based on face recognition information of the user, or may be determined based on user information received by the information receiver 310. In this case, at least one or more of a plurality of additional services that may be provided by the service providing unit 340 may be predetermined. In addition, the user information may include information such as gender, age, hobby, occupation, interest information of the user, and the additional service may be a customized recommendation service determined based on the user information.

Alternatively, the service provider 340 transmits a plurality of additional services that can be provided to the TV playback apparatus 100 or the mobile playback apparatus 200 to receive the additional services, and selects at least one or more of the transmitted additional service lists. Additional services to be provided may be determined based on user input.

When there is only one user of the TV player 100, the service provider 340 may provide an additional service to the TV player 100. That is, when there is only one user displayed in the face recognition information of the user of the TV playback apparatus 100 received by the information receiver 310, the service provider 340 may provide an additional service to the TV playback apparatus 100 and the mobile playback apparatus ( The user may be determined which of the playback devices 200 are to be provided. At this time, the service provider 340 may provide the additional service to the TV playback apparatus 100 or the mobile playback apparatus 200 by the user's decision.

When there are several users of the TV playback apparatus 100, the service provider 340 may transmit the additional service to the mobile playback apparatus 200. At this time, the owners of the plurality of mobile playback apparatus 200 may be different. That is, a case where several people having each mobile playback device 200 use the TV playback device together. In addition, the TV playback apparatus 100 may simultaneously provide additional services to the plurality of mobile playback apparatuses 200, and all of the additional services provided may be the same, or different additional services may be provided for each user. . As described above, when different additional services are provided for each user, each additional service provided differently may be determined based on face recognition information or user information of each user.

The user information that is the basis of the additional service decision may be previously stored in the DB 390. That is, a user who has previously used a service may use previously stored user information without having to transmit separate user information to the service providing apparatus 300.

As an embodiment of the present invention, a process of providing an additional service to the mobile playback apparatus 200 is as follows. The service providing apparatus 300 may transmit the information about the additional service determined by the service providing apparatus 300 to the TV playback apparatus 100 based on the information of the mobile playback apparatus 200, and the TV playback apparatus 100 may Information on the received additional service may be transmitted to the mobile playback apparatus 200 through the pairing server 400. The mobile reproducing apparatus 200 transmits the information on the received additional service to an additional service providing server (not shown) that directly provides the additional service. By the additional service can be provided.

DB 390 stores the data. In this case, the data includes data input and output between the components of the service providing apparatus 300, and input and output between the service providing apparatus 300 and the components outside the service providing apparatus 300. Contains data. For example, the DB 390 may store face recognition information received by the information receiver 310. An example of such a DB 390 includes a hard disk drive, a read only memory (ROM), a random access memory (RAM), a flash memory, a memory card, or the like existing inside or outside the service providing apparatus 300.

Those skilled in the art, each of the information receiving unit 310, face recognition information comparison unit 320, interlocking unit 330, service provider 340 and DB 390 is implemented separately, or one or more of them are integrated and implemented I will understand enough.

Hereinafter, the operation of the mobile playback device 200 of FIG. 1 will be described in more detail.

3 is a block diagram of the mobile playback apparatus 200 shown in FIG. 1 according to an embodiment of the present invention. Referring to FIG. 3, the mobile playback apparatus 200 may include an information input unit 210, an information transmitter 220, an interworking unit 230, an additional service receiver 240, and a DB 290. However, the mobile playback apparatus 200 shown in FIG. 3 is only one implementation example of the present invention, and various modifications may be made based on the components shown in FIG. 3. For example, the mobile playback device 200 may further include a user interface for receiving a certain command or information from the user. In this case, the user interface may generally be an input device such as a keyboard, a mouse, or the like, or may be a graphical user interface (GUI) expressed on the image display device.

The information input unit 210 may receive face recognition information through a camera device. In this case, the camera device may be a camera embedded in the mobile playback device 200 or may be a camera connected to the outside of the mobile playback device 200.

The information transmitter 220 may transmit the face recognition information received from the information inputter 210 to the service providing apparatus 300. In this case, the transmitted face recognition information may be used by the service providing apparatus 300 to determine whether the mobile playback apparatus 200 and the TV playback apparatus 100 interoperate with each other.

The information transmitter 220 may further transmit user information to the service providing apparatus 300. Otherwise, the TV playback apparatus 100 may further transmit user information to the service providing apparatus 300. In this case, the transmitted user information may be information previously stored in the DB 290 or may be information newly input from the information input unit 210.

The interlocking unit 230 may interwork with the TV playback apparatus 100 by the service providing apparatus 300. That is, when the service providing apparatus 300 recognizes the user of the TV playback apparatus 100 and the mobile playback apparatus 200 as the same user, the linkage unit 230 may perform the pairing server 400 from the service providing apparatus 300. The session of the TV playback apparatus 100 and the mobile playback apparatus 200 may be connected by the pairing server 400 based on the connection signal transmitted to the.

The additional service receiver 240 may receive an additional service from the service providing apparatus 300. In this case, the additional service may be a service corresponding to content to be reproduced or to be reproduced in the TV playback apparatus 100.

The additional service transmits an application corresponding to the content being played or to be played on the TV playback apparatus 100 to the mobile playback apparatus 200, or transmits a URL address to the mobile playback apparatus 200, or the mobile playback apparatus 200. ) May be provided in such a manner as to transmit a signal for activating an application installed in the mobile play device 200. In this case, the transmitted application may be a web application, and in the case of an application requiring download, the application may be installed on the mobile playback device 200 after receiving the approval of the download from the mobile playback device 200. It can be executed automatically or manually.

The additional service may be various kinds of services. The supplementary service may be a broadcast supplementary information providing service including information about a performer appearing in content, an article related to an object, information related to an object such as a background, music, and the like. At this time, the background may be a photographic place, a historic place, a restaurant, a summer resort, and the like. In addition, the additional service may be a search service that provides a web search result related to the content, or may be an SNS service that exchanges opinions corresponding to the content or provides postings of others on a social network.

In addition, the additional service may be determined by the service providing apparatus 300 based on the user information transmitted from the information transmitter 220.

The additional service received by the additional service receiving unit 240 may be different from the additional service provided to another mobile playback device linked to the TV playback device 100.

DB 290 stores the data. At this time, the data includes data input and output between the components of the mobile playback device 200, and input and output between the mobile playback device 200 and the components outside the mobile playback device 200 Contains data. For example, the DB 290 may store the type of additional service received by the additional service receiver 240 and a method of providing the additional service. An example of such a DB 290 includes a hard disk drive, a read only memory (ROM), a random access memory (RAM), a flash memory, a memory card, or the like existing inside or outside the mobile playback apparatus 200.

Those skilled in the art may separately implement the information input unit 210, the information transmitter 220, the interlocking unit 230, the additional service receiver 240, and the DB 290, or one or more of them may be integrated. I will understand enough.

4 is a flowchart illustrating a method of interlocking a playback device by a service providing device according to an embodiment of the present invention. The method for interworking the playback apparatus by the service providing apparatus according to the embodiment shown in FIG. 4 includes steps that are processed in time series in the service providing apparatus 300 according to the embodiment shown in FIG. 2 or 3. Therefore, although omitted below, the contents described with respect to the service providing apparatus 300 of FIG. 2 or 3 also apply to the method of interworking the playback apparatus by the service providing apparatus according to the embodiment shown in FIG. 4.

In operation S401, the service providing apparatus 300 may receive first face recognition information from the TV playback apparatus 100.

In operation S402, the service providing apparatus 300 may receive second face recognition information from the mobile playback apparatus 200.

In operation S403, the service providing apparatus 300 may compare whether the first face recognition information and the second face recognition information, each of which is received in steps S401 and S402, match. That is, it may be determined whether the user of the TV playback apparatus 100 and the user of the mobile playback apparatus 200 are the same person.

If it is determined in step S403 that the user of the TV playback apparatus 100 and the user of the mobile playback apparatus 200 are others, the service is terminated.

If it is determined in step S403 that the user of the TV playback apparatus 100 and the user of the mobile playback apparatus 200 are the same person, in step S404 the service providing apparatus 300 is the TV playback apparatus 100 and the mobile playback apparatus 200. Can be linked.

In operation S405, the service providing apparatus 300 may provide a content service to the TV playback apparatus 100.

In operation S406, the service providing apparatus 300 may provide an additional service to the mobile playback apparatus 200. However, when there is only one mobile playback device 200 interworking with the TV playback device 100, that is, when there is only one user of the TV playback device 100, the service providing device 300 provides the TV playback device 100 to the TV playback device 100. As described above, it is possible to provide additional services.

The order between the above-described steps S401 to S406 in FIG. 4 is merely an example, and is not limited thereto. In other words, the order between the above-described steps may be interchanged, and some of the steps may be executed simultaneously. Specifically, step S405 may be performed even before step S403, and even if it is determined that the user of the TV playback apparatus 100 and the user of the mobile playback apparatus 200 are others in step S403, step S406 may be performed.

In addition, steps S401 to S403 may be periodically repeated every predetermined time, and may be performed again in response to a user input.

5 is a flowchart illustrating a method of interworking with a TV playback device by a mobile playback device according to an embodiment of the present invention. The method of interworking with the TV playback apparatus by the mobile playback apparatus according to the embodiment illustrated in FIG. 5 includes steps that are processed in time series in the mobile playback apparatus 200 according to the embodiment illustrated in FIG. 2 or 3. Therefore, even if omitted below, the contents described with respect to the mobile playback apparatus 200 of FIG. 2 or 3 may also be applied to the method of interworking with the TV playback apparatus by the mobile playback apparatus according to the embodiment shown in FIG. 5. .

In operation S501, the mobile playback apparatus 200 may receive face recognition information.

In operation S502, the mobile reproduction apparatus 200 may transmit the face recognition information received in operation S501 to the service providing apparatus 300.

In operation S503, the mobile reproduction apparatus 200 may be linked with the TV reproduction apparatus by the service providing apparatus 300 based on the face recognition information transmitted in operation S502.

In operation S504, the mobile playback apparatus 200 may receive an additional service from the service providing apparatus 300.

An embodiment of the present invention may also be implemented in the form of a recording medium including instructions executable by a computer, such as a program module executed by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery media.

The foregoing description of the present invention is intended for illustration, and it will be understood by those skilled in the art that the present invention may be easily modified in other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as distributed may be implemented in a combined form.

The scope of the present invention is shown by the following claims rather than the detailed description, and all changes or modifications derived from the meaning and scope of the claims and their equivalents should be construed as being included in the scope of the present invention. .

100: TV playback device
200: mobile playback device
201: first mobile playback device
202: second mobile playback device
203: third mobile playback device
300: service providing device
400: pairing server

Claims (14)

In the service providing device for interlocking a playback device,
An information receiver configured to receive first face recognition information from the TV playback apparatus and receive second face recognition information from the mobile playback apparatus;
A face recognition information comparing unit comparing the received first face recognition information and second face recognition information;
An interlocking unit interlocking the TV playback device and the mobile playback device when the received first face recognition information and second face recognition information match; And
A service providing unit which provides a content service to the TV playback device, and provides an additional service corresponding to the content to the mobile playback device;
The first face recognition information is information input using a camera connected to the TV playback apparatus, and the second face recognition information is information input using a camera connected to the mobile playback apparatus.
The method of claim 1,
And the service providing unit provides the supplementary service to the TV playback device when there is only one mobile playback device associated with the TV playback device.
The method of claim 1,
The additional service includes any one of an application program transmission scheme corresponding to the content, a URL address transmission scheme, and an application program usage scheme pre-installed on the mobile playback device.
The method of claim 1,
The additional service includes at least one of information of the content, information on an object appearing in the content, a search page, and an SNS service.
The method of claim 1,
The information receiver further receives user information from the TV playback apparatus or the mobile playback apparatus,
And the additional service is determined based on the user information.
The method of claim 5,
The user information, the service providing device that the additional service to be provided in the TV playback device or the mobile playback device includes the information specified in advance.
The method of claim 1,
When there are a plurality of mobile playback devices interoperating with the TV playback device, the additional service is provided to the plurality of mobile terminals.
The method of claim 7, wherein
The additional service provided to each of the plurality of mobile terminals is determined based on the information of the plurality of mobile terminals.
The method of claim 2,
And the additional service is determined based on face recognition information received from the TV playback device.
In the method of interlocking a playback device,
Receiving first face recognition information from a TV playback device;
Receiving second face recognition information from the mobile playback device;
Comparing the received first face recognition information with second face recognition information;
Interworking the TV playback device and the mobile playback device when the received first face recognition information and second face recognition information match;
Providing a content service to the TV playback device; And
Providing an additional service corresponding to the content to the mobile playback device;
The first face recognition information is information input using a camera connected to the TV playback apparatus, and the second face recognition information is information input using a camera connected to the mobile playback apparatus.
In a mobile playback device that works with a TV playback device,
An information input unit configured to receive face recognition information using a camera connected to the mobile playback device;
An information transmitter to transmit the received face recognition information to a service providing apparatus;
An interlocking unit interlocked with the TV playing apparatus by the service providing apparatus; And
An additional service receiving unit which receives the additional service from the service providing apparatus;
The received additional service corresponds to content played by the linked TV player,
The transmitted face recognition information is used by the service providing device to determine whether to interwork with the TV playback device.
The interlocking operation is determined by comparing the face recognition information with face recognition information input using a camera connected to the TV playback device.
The method of claim 11,
The information transmitter further transmits user information to the service providing apparatus.
And the additional service is determined based on the user information transmitted from the service providing device.
The method of claim 11,
The received additional service is different from the additional service provided to another mobile playback device linked to the TV playback device.
In the method that the mobile playback device is linked with the TV playback device,
Receiving face recognition information using a camera connected to the mobile playback device;
Transmitting the received face recognition information to a service providing device;
Interworking with the TV playback device by the service providing device; And
Receiving an additional service from the service providing apparatus;
The received additional service corresponds to content played by the linked TV player,
The transmitted face recognition information is used by the service providing device to determine whether to interwork with the TV playback device.
The interlocking method is determined by comparing the face recognition information with face recognition information input using a camera connected to the TV playback apparatus.

Images