KR102678394B1 - System for location-based augmented reality memo advertisement service and advertisement service method of the system - Google Patents

Abstract

The present invention relates to a location-based augmented reality memo advertising service system and an advertising service method of the system. The location-based augmented reality memo advertising service system according to an embodiment of the present invention is an online advertisement service system corresponding to a random location in the real world. A user selects a virtual location and sets a memo to notify users, and if it is within the specified range of a random location, the user who has set the memo or other users displays the (pre)set memo on the screen in the form of augmented reality (AR). When the terminal device and the user terminal device are within the specified range, the access rights to the (pre)set memo are checked, and based on the confirmation result, the (pre)set memo is provided to the user terminal device in the form of augmented reality. May include advertising devices.

Description

Location-based augmented reality memo advertising service system and advertising service method of the system {SYSTEM FOR LOCATION-BASED AUGMENTED REALITY MEMO ADVERTISEMENT SERVICE AND ADVERTISEMENT SERVICE METHOD OF THE SYSTEM}

The present invention relates to a location-based augmented reality memo advertising service system and an advertising service method of the system. More specifically, the present invention relates to a location-based augmented reality memo advertising service system and an advertising service method of the system. More specifically, users write notes, etc. in a desired location online, and they or other users view augmented reality at that location. It relates to a location-based augmented reality memo advertising service system that allows users to view notes left by themselves or others and an advertising service method of the system.

Augmented Reality (AR) technology began to be commercialized with the development of smartphones. Although it is a field of Virtual Reality (VR) technology, it has a different meaning from virtual reality. Virtual reality technologies allow users to immerse themselves in a virtual world and cannot see the real world, but augmented reality technology allows users to see the real world and presents the user with a combination of the real world and virtual objects. In other words, virtual reality replaces the real world with a virtual world, but augmented reality provides users with a slightly higher sense of reality by supplementing the real world by superimposing virtual objects on the real world.

The modern era is defined as the era of communication. Netizens share their thoughts and feelings with other netizens by leaving comments on Internet articles, and commenting is sometimes considered a form of play. In addition, with the development of mobile devices such as smartphones, social media (SNS) such as Twitter and Facebook, which have become commonplace, are becoming a great force in forming public opinion and people's political participation. Accordingly, information and communication technology is no longer hard and boring, but is increasingly recognized as a technology that creates a more interesting and more humane world. With the development of the national economy, the consciousness and standard of living of our people have also improved significantly, so that it is now a matter of livelihood. Rather, the time and effort devoted to finding fun in everyday life and individual self-development is increasing.

Of course, there have been various attempts to use augmented reality technology for commercial purposes in the past, and although services are currently being provided on the market, the technology is used slightly differently for each purpose, so the development of services to meet the various needs of consumers is difficult. It is continuously being demanded.

Korean Patent Publication No. 10-2004-0047314 Korean Patent Publication No. 10-1188179 Korean Patent Publication No. 10-2336653 Korean Patent Publication No. 10-1545138

The present invention is intended to solve the above problem. Specifically, users can write notes, etc. in a desired location online, and they or other users can view the notes left by themselves or others using augmented reality at that location. The purpose is to provide a location-based augmented reality memo advertising service system and an advertising service method of the system.

The problems of the present invention are not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below.

The location-based augmented reality memo advertising service system according to an embodiment of the present invention to solve the above problem selects an online virtual location corresponding to a random location in the real world and sets a memo to notify users, A user terminal device that displays the set memo on a screen in the form of augmented reality (AR) to the user who set the memo or another user if it is within a designated range of the random location, and when the user terminal device is within the designated range, It may be configured to include an augmented reality memo advertising device that checks access rights to the set memo and provides the set memo in augmented reality form to the user terminal device based on the confirmation result.

The augmented reality memo advertising device, when access rights are granted to a plurality of users who can check the set memo, sets the setting when the locations of the user terminal devices possessed by the plurality of users are all confirmed within the specified range. Access to one note can be permitted.

The augmented reality memo advertising device may check contact information stored in the user terminal device as the access authority and allow access to the set memo based on the confirmation result.

The augmented reality memo advertising device may notify a notification related to the set memo when the user terminal device of the user who set the memo is within the designated range.

The augmented reality memo advertising device displays the memo contents of the set memo on the screen when the set memo is selected on the augmented reality screen in the user terminal device for conversation with the user who set the memo. A chat button can also be displayed.

In addition, the location-based augmented reality memo advertising service method according to an embodiment of the present invention selects an online virtual location corresponding to a random location in the real world on the user terminal device and sets a memo to notify users, A step of displaying the set memo on the screen in augmented reality (AR) form to the user who set the memo in the user terminal device or another user if it is within a specified range of a random location, and an augmented reality memo advertising device, the user terminal device It may be configured to include the step of checking access rights to the set memo when the device is within the specified range and providing the set memo in augmented reality form to the user terminal device based on the confirmation result.

The providing step is performed when access rights are granted to a plurality of users who can check the set memo, and the locations of the user terminal devices possessed by the plurality of users are all confirmed within the specified range. Access can be permitted.

In the providing step, contact information stored in the user terminal device as the access authority may be checked and access to the set memo may be permitted based on the verification result.

In the providing step, a notification related to the set memo may be notified when the user terminal device of the user who set the memo is within the specified range.

The step of providing is, when the set memo is selected on the augmented reality screen in the user terminal device, the memo contents of the set memo are displayed on the screen and a chat button for conversation with the user who set the memo. can be displayed together.

According to an embodiment of the present invention, general users will be able to check the memo in augmented reality at the location where they want to view the memo and use the desired service.

Additionally, according to an embodiment of the present invention, corporate users will be able to conduct location-based marketing and events.

The effects according to the present invention are not limited to the contents exemplified above, and further various effects are included in the present specification.

Figure 1 is a diagram illustrating the configuration of a location-based augmented reality memo advertising service system according to an embodiment of the present invention.
Figure 2 is an example diagram illustrating a location-based augmented reality memo writing process according to an embodiment of the present invention.
Figure 3 is a diagram for explaining a location-based augmented reality memo confirmation operation according to an embodiment of the present invention.
Figure 4 is a block diagram illustrating the detailed structure of the augmented reality memo advertising device of Figure 1.
Figure 5 is a flowchart of a location-based augmented reality memo advertising method according to an embodiment of the present invention.

The advantages and features of the present invention and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely provided to ensure that the disclosure of the present invention is complete and to be understood by those skilled in the art in the technical field to which the present invention pertains. It is provided to fully inform those who have the scope of the invention, and the present invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

Figure 1 is a diagram illustrating the configuration of a location-based augmented reality memo advertising service system according to an embodiment of the present invention, and Figure 2 is an exemplary diagram illustrating the location-based augmented reality memo writing process according to an embodiment of the present invention. , Figure 3 is a diagram for explaining a location-based augmented reality memo confirmation operation according to an embodiment of the present invention.

As shown in Figure 1, the location-based augmented reality memo advertising service system 90 according to an embodiment of the present invention is a part or part of the user terminal device 100, the communication network 110, and the augmented reality memo advertising device 120. includes everything.

Here, “including part or all” means that some components such as the communication network 110 are omitted and the user terminal device 100 and the augmented reality memo advertising device 120 perform direct communication (e.g., P2P, etc.) Or, it means that some or all of the components that make up the augmented reality memo advertising device 120 can be integrated and configured into a network device (e.g., wireless exchange device, etc.) that makes up the communication network 110. , it is explained as including everything in order to facilitate a sufficient understanding of the invention.

The user terminal device 100 is preferably a mobile-based terminal device such as a smartphone carried by users, a wearable device worn on the user's wrist, or a tablet PC. Of course, the user terminal device 100 is preferably a mobile-based terminal device such as a smartphone if users want to view augmented reality-based memos or memo advertisements (or advertisement information) by viewing the scene in the real world, but the memo When an advertisement is set online in a virtual location corresponding to a random location in the real world, it is not limited to the above mobile-based terminal devices, and may also include PC-based terminal devices such as desktop computers or laptop computers. Therefore, in the embodiment of the present invention, the user terminal device 100 will not be specifically limited to any one type.

For example, the target of setting a memo advertisement using the user terminal device 100 may be a general user such as an individual, but may also be a corporate user. General users can access the service of the augmented reality memo advertising device 120 of FIG. 1, search or designate a random location in the real world, and then set a memo advertisement of their desired type at the searched location. Memo advertisements for general users may include general memos, image memos, video memos, and secure memos (e.g., memos that can be opened through authentication such as a password). Of course, in general memos, if a user has compiled a list of items he or she wants to purchase at an outlet, for example, it is possible to check this in augmented reality upon arriving at the location. Alternatively, in the case of a memo advertisement set by another user, if you have access rights, you can access the memo advertisement and check the contents. For example, assuming an individual is holding an exhibition, it is possible to set up a memo advertisement to advertise the exhibition.

The memo advertisement according to an embodiment of the present invention displays the memo in the form of an icon to distinguish the type of memo (e.g., general memo, image memo, video memo, etc.) shown on the augmented reality screen, and also displays the memo when the icon is selected. It can be divided into stages that show the actual data of the content or video, and can be seen as a concept that includes all of these. Therefore, setting a memo may actually mean recording the memo contents (e.g., text) or registering a video. In this case, the augmented reality memo advertising device 120 can automatically determine the type of memo, such as whether the attached memo is text or video, and automatically generate the corresponding icon. Of course, the embodiment of the present invention will not be particularly limited to this operation.

In addition, general users can create an augmented reality memo, such as a memorial memo, that can be recorded forever instead of a physical memo if an accident occurs in a specific location. Therefore, when a user shines a light on a memorial using the user terminal device 100, a memo advertisement may be displayed, and the memo advertisement may be accessed to check memorial phrases left by various users. In addition, for general users, a video to recall memories can be set as a memo advertisement for location-based recording, and other users can check what records have been left at that location and communicate with other users. Communication can take place in the form of chat or comments. For example, in the case of a video, a video icon is displayed on the augmented reality screen, and when a memo advertisement is accessed through the video icon, the video linked thereto can be played on the user terminal device 100.

Additionally, corporate users can set memo advertisements for location-based marketing and events through the user terminal device 100. Corporate memos that corporate users can leave may include general memos, coupons, image memos, video memos, etc. Even for corporate users, after searching or designating a specific location in the real world online, an icon of a type such as a coupon or video memo appears on the augmented reality screen at that location, and through this, the user can access the memo and check the coupon. You can perform actions such as:

More specifically, users of the user terminal device 100 can access the service of the augmented reality memo advertising device 120 of FIG. 1 and search for a coffee restaurant in a specific location through a search as shown in FIG. 2. And in order to set the memo advertisement you want for the coffee shop, you can press the selection button and perform various actions to set the memo advertisement. Figure 2 shows that when a memo advertisement is already set, a notification is provided when the Starbucks building is within a designated range. Of course, since various UI screens for setting up memo advertisements can be provided, embodiments of the present invention will not be particularly limited to any one type. However, if the user sets a memo advertisement for the corresponding coffee shop, such as Starbucks Sungnyemun branch, the corresponding data may be provided to the augmented reality memo advertisement device 120 of FIG. 1 and stored in the DB 120a. Thereafter, when users request an augmented reality service with the user terminal device 100 by being located within a designated range based on the Starbucks Sungnyemun branch, the augmented reality memo advertising device 120 of FIG. 1 is located within a designated range based on the Starbucks Sungnyemun branch. Memo advertisements can be displayed on the screen in augmented reality. Of course, if the user requests notification during this process, notification is provided.

Many users can set up memo ads in the same location. In this case, the augmented reality memo advertising device 120 can selectively display a memo advertisement of a nearby time on the screen in augmented reality based on time information, or display a representative icon indicating that there is a memo advertisement at the corresponding location on the user terminal device ( 100), and when the icon is selected, a list of memo advertisements set at that location can be displayed for the user to select. Above all, in an embodiment of the present invention, when a user sets a memo advertisement at a specific location in the real world online, access rights are granted, and the memo advertisement is displayed on the screen in augmented reality according to the access permission. This can prevent the problem of many memo advertisements being displayed on the screen, which reduces user readability.

Typically, in the case of general users using the user terminal device 100, access rights are set so that all specific people can check the memo advertisement when they are within a specified range (e.g. radius) based on the location where the memo advertisement is set. You can. In other words, when the user terminal devices 100 of the users who have been granted access rights are all within the designated range, the augmented reality memo advertising device 120 of FIG. 1 measures the user terminal devices 100 of the users who have been granted access rights. To do this, check whether all relevant users are within the designated range and access the memo advertisement. Additionally, general users can be allowed to access memo advertisements set by random users based on contact information such as phone numbers stored in their user terminal device 100. In other words, when a random user arrives at a specific location in the real world through his or her user terminal device 100 and displays the surroundings, the augmented reality memo advertising device 120 of FIG. 1 recognizes this and displays the corresponding user terminal device 100. ), data related to contact information can be shared through communication, and through this, when the same contact number is confirmed, a memo advertisement set by the user matching the contact number can be displayed on the augmented reality screen.

Of course, in the case of corporate users, when setting up a memo advertisement, you can set which general users will be allowed to access the memo advertisement. For example, in order to enter a building where an exhibition is held, a memo advertisement set by the relevant company user can be selected. In this case, only limited users can access the memo advertisement set by the corporate user by providing a password or providing information related to the password (e.g. URL information to access the password, etc.) so that only users who are permitted to access can access it. . Of course, in the case of advertisements intended to be disclosed to general users, such as corporate advertisements or product advertisements, a memo advertisement can be set by specifying a place where many people gather, such as a subway station, or the location of a specific building, and users can use the augmented reality service. When requesting, a memo advertisement that allows access to general advertisements through the user terminal device 100 of the relevant users can be displayed on the screen. Of course, when selecting the relevant memo advertisement, various subsequent operations can be performed, such as allowing the user to watch a video of a general advertisement or download a coupon, so the embodiment of the present invention will not be specifically limited to any one operation.

The communication network 110 includes both wired and wireless communication networks. For example, a wired or wireless Internet network may be used or linked as the communication network 110. Here, the wired network includes Internet networks such as cable networks and public switched telephone networks (PSTN), and the wireless communication network includes CDMA, WCDMA, GSM, EPC (Evolved Packet Core), LTE (Long Term Evolution), and Wibro networks. It means including. Of course, the communication network 110 according to an embodiment of the present invention is not limited to this, and can be used as an access network for a next-generation mobile communication system to be implemented in the future, for example, a cloud computing network in a cloud computing environment, a 5G network, etc. For example, if the communication network 110 is a wired communication network, the access point within the communication network can connect to the telephone company's exchange office, etc., but in the case of a wireless communication network, data is processed by connecting to the SGSN or GGSN (Gateway GPRS Support Node) operated by the communication company, or Data can be processed by connecting to various repeaters such as BTS (Base Transceiver Station), NodeB, and e-NodeB.

Communication network 110 may also include access points. Access points may include small base stations, such as femto or pico base stations, which are often installed in buildings. Here, femto or pico base stations can be classified according to the maximum number of user terminal devices 100, etc., that can be connected to them in the classification of small base stations. Of course, it may include a short-distance communication module for performing short-distance communication such as Zigbee and Wi-Fi with the user terminal device 100. Access points can use TCP/IP or RTSP (Real-Time Streaming Protocol) for wireless communication. Here, in addition to Wi-Fi, short-range communication can be performed using various standards such as Bluetooth, Zigbee, infrared (IrDA), RF (Radio Frequency) such as UHF (Ultra High Frequency) and VHF (Very High Frequency), and ultra-wideband communication (UWB). You can. Accordingly, the access point can extract the location of the data packet, designate the best communication path for the extracted location, and forward the data packet to the next device, such as the augmented reality memo advertising device 120, along the designated communication path. Access points can share multiple lines in a typical network environment and include, for example, routers, repeaters, and repeaters.

The augmented reality memo advertising device 120 allows general users or corporate users using the user terminal device 100 to set memo advertisements online in response to specific locations in the real world (e.g., locations of subway stations or specific buildings, etc.). And, when users request an augmented reality service at a location in the real world, a memo advertisement set at that location is displayed on the augmented reality screen. Figure 3 shows this. In other words, when the user terminal device 100 runs an application (hereinafter referred to as an app) to use a service according to an embodiment of the present invention at a specific location, the camera may operate. The camera can contain the surroundings of the real world, in other words, the screen of the user terminal device 100 displays the area where the camera shines, and in this case, the augmented reality memo advertising device 120 is displayed on the screen of the user terminal device 100. ) Based on the location of the camera, it detects where the camera is pointing and displays various types of memo advertisements set at that location on the screen. That is, an image of the real world is displayed on the screen of the user terminal device 100, and a memo advertisement set by the user in the virtual world, that is, online, is displayed on the screen again. Of course, memo advertisements may display various types of icons depending on the type of memo advertisement. Various forms can be possible, from a memo advertisement icon that simply announces a message to a memo advertisement that announces a video. This is clearly shown in Figure 3.

More specifically, the augmented reality memo advertising device 120 is such that when a user writes a memo in a location selected online, another user or a user with access to the written memo can use augmented reality at that location in the real world to This service allows users to view notes left by users. At this time, the user can select and selectively view acquaintance notes based on his or her contact information in the user terminal device 100. In addition, the user may be notified when a memo he has left enters the vicinity or radius of a designated location according to his settings and may be able to check the memo. Furthermore, users can also chat where they can check other users' notes and send messages to other users. The augmented reality memo advertising device 120 can be considered to actually service these operations with the user terminal device 100. For example, when a user selects a specific memo advertisement on the augmented reality screen, the user can move to a screen that provides memo information, and a chat button may be displayed on the screen. Therefore, the user can select the corresponding chat button to conduct a messenger-based conversation with the user who has set up a memo advertisement. In addition, corporate users can subscribe to the service of the augmented reality memo advertising device 120 of FIG. 1 and write a memo to be displayed to the user in a desired location. If location-based marketing is necessary, the platform can be used to provide advertisements and coupons. Delivery, etc. can be carried out. In this process, you can also set it so that authorized users can check notes through the map.

In addition, the augmented reality memo advertising device 120 operates so that the user can only view other users' memos, not the user's own memos, within a specified radius based on the current location. At this time, the radius may vary depending on the service policy. For example, by default, 10m is specified and notes within 10m can only be viewed in augmented reality or on a map, but it is also possible to provide a wider radius depending on the user's service level. For example, when the service is paid, multiple package products can be sold and service levels can be differentially applied depending on the type of package product purchased by the user. Alternatively, if users frequently use the service, service levels can be set and differentiated based on frequency.

In addition, the augmented reality memo advertising device 120 allows information to be shared in a specific location based on the pre-shared password in order to share information between specific users when applying a password, i.e. password input, to a memo advertisement. For example, if a general memo or video memo is set up through a memo advertisement at the appropriate location in the school library, and a password is set, users who share the password can access the memo advertisement and check the contents of the general memo or video. You can. Furthermore, the augmented reality memo advertising device 120 may apply an automatic authentication method. For example, if user A designates four people with whom he or she wants to share information and discloses the information in a specific location, the system will operate so that information can be shared without a password if four sharers with information sharing authority are located in a specific location at the same time. You can.

Furthermore, the augmented reality memo advertising device 120 according to an embodiment of the present invention can provide a service that allows users to select and view acquaintances' memos based on their contact information. Even in this case, the augmented reality memo advertising device 120 can operate in connection with the augmented reality location-based. For example, when a user checks a memo through augmented reality at a specific location, the memo left by a user registered on his or her mobile phone indicates that the user has a phone number saved in his or her mobile phone. This is the case when it is displayed on the augmented reality screen. Of course, even if it is someone else's memo saved on your phone, it must be open or shared with all users to be able to check it.

So far, we have explained how you can set up a memo advertisement online by specifying a specific location in the real world, or more precisely, the name of a building online, and check it through augmented reality. However, the augmented reality memo advertising device 120 according to an embodiment of the present invention can set memo advertisements in relation to various products located inside the building. For example, let's assume that a user accesses the augmented reality memo advertising device 120 of FIG. 1 as shown in FIG. 2 and searches for Starbucks Sungnyemun branch and wants to set a memo advertisement inside Starbucks. Of course, regarding the interior, you can film the interior in advance and view the interior in various forms, such as VR. Accordingly, the user of the user terminal device 100 can visit the inside of a specific building online to see the inside and then set a memo advertisement by specifying a specific product, etc. For example, a representative example would be taking notes on the contents of an exhibition work.

In this case, the augmented reality memo advertising device 120 has a memo advertisement set for a specific product inside the building, so when users look at the surrounding area from the inside of the building with a camera, it displays the memo advertisement set inside in augmented reality. will be. Of course, this operation can be done by determining the location of the user terminal device 100 in the augmented reality memo advertising device 120, so that it can be known that it is located within the Starbucks building, so when the user looks at the surroundings with a camera to use the augmented reality service, The user terminal device 100 receives the image captured by the camera and determines where it will be projected, or in the case of the user terminal device 100, it includes a gyro sensor or an acceleration sensor, so the user uses the user terminal device 100 based on the sensing data of these sensors. It is possible to determine where the light is projected using . Therefore, the augmented reality memo advertising device 120 can provide an augmented reality memo advertising service even to the inside of a building.

Figure 4 is a block diagram illustrating the detailed structure of the augmented reality memo advertising device of Figure 1.

As shown in Figure 4, the augmented reality memo advertising device 120 of Figure 1 includes part or all of a communication interface unit 400, a control unit 410, an augmented reality memo advertising unit 420, and a storage unit 430. Includes.

Here, “including part or all” means that the augmented reality memo advertising device 120 is configured by omitting some components, such as the storage unit 430, or that some components, such as the augmented reality memo advertising unit 420, are omitted. This means that it can be integrated and configured with other components such as the augmented reality memo advertising unit 420, and is explained as including everything to facilitate a sufficient understanding of the invention.

The communication interface unit 400 communicates with the user terminal device 100 via the communication network 110 of FIG. 1. The communication interface unit 400 can perform operations such as modulation/demodulation, muxing/demuxing, encoding/decoding, and scaling to convert resolution during the communication process. This is obvious to those skilled in the art, so further description is omitted. do. Here, scaling refers to processing image data according to the screen size of a smartphone, etc.

The communication interface unit 400 provides a location-based augmented reality memo advertisement service according to an embodiment of the present invention when the user terminal device 100 of FIG. 1 requests a service. For example, when the app is run on the user terminal device 100, a pop-up window asking 'Do you want to set up a memo advertisement' may be displayed on the screen while providing various types of main screens. When the user selects the confirmation button to set the memo advertisement, the communication interface unit 400 can transmit the map and search window screen to the user terminal device 100 under the control of the control unit 410, as shown in FIG. 2.

In addition, when the user searches after entering a specific building or location in the search box on the screen as shown in FIG. 2, the communication interface unit 400 provides search results such as the store name and building name searched by the user as shown at the bottom of FIG. 2. may be displayed. Then, when the user presses the selection button, the communication interface unit 400 can perform various operations to set the memo advertisement desired by the user at the corresponding location. Of course, if a memo advertisement has already been set, it is possible to view the detailed contents of the memo advertisement by selecting the corresponding selection button after the notification as shown in Figure 2. Therefore, in the embodiment of the present invention, it is specifically limited to one form. I won't do it.

The control unit 410 is responsible for the overall control operation of the communication interface unit 400, augmented reality memo advertisement unit 420, and storage unit 430 of FIG. 4. For example, when there is a service request for setting up a memo advertisement in the user terminal device 100 of FIG. 1, the control unit 410 can control the augmented reality memo advertisement unit 420 to execute a program mounted therein. Accordingly, users can perform memo advertisement setting operations.

Additionally, when an augmented reality service is requested after executing an app on the user terminal device 100, the control unit 410 performs an operation to provide the augmented reality service in conjunction with the augmented reality memo advertising unit 420. For example, when a service request is made from the user terminal device 100, the control unit 410 may also receive location information about the current location. Since the user terminal device 100 is equipped with a GPS module inside, it can receive latitude and longitude generated through communication with a satellite navigation system (GPS) in the form of coordinate values, and can determine the current user's location through this. You can. Of course, for this location determination, the augmented reality memo advertising unit 420 in the DB 120a of FIG. 1 can construct map data for the entire area by dividing it into cells, and coordinate values for each cell. You can specify and save. Therefore, when location information of the user terminal device 100 is provided, map data can be searched based on the location information, and a memo advertisement for a matching cell can be created and provided on a screen in the form of augmented reality.

Of course, users of the user terminal device 100 can check various memo advertisements set online by general users or corporate users for specific locations in the real world in the form of augmented reality by changing the position of the surroundings, and at this time, the user terminal When the camera position of the device 100 is changed, the control unit 410 controls the user terminal device 100 based on sensing data generated through a gyro sensor or acceleration sensor mounted inside the user terminal device 100. It is possible to determine how the camera moves, and based on the calculated movement of the user terminal device 100, the location where the camera is projected is determined and a memo advertisement matching that is provided to the user terminal device 100. The control unit 410 may participate in these operations in conjunction with the augmented reality memo advertising unit 420.

The augmented reality memo advertisement unit 420 can perform an operation to set a memo advertisement according to the service request of the user terminal device 100 of FIG. 1, and also when the user terminal device 100 requests an augmented reality service. An operation is performed to serve a preset memo advertisement in augmented reality format. When the augmented reality memo advertisement unit 420 searches for a place corresponding to a specific location in the real world online through a location search on the user terminal device 100 and then sets a memo advertisement at that location, the location information of the location is provided. You can save memo advertisements set by users by matching with . For example, the Starbucks Sungnyemun branch searched by the user may have latitude and longitude information in the form of coordinate values (x1, y1). And memo advertisements set by multiple users may be matched to that location. Therefore, the augmented reality memo advertisement unit 420 can display the memo advertisement in augmented reality form on the screen where the Sungnyemun branch is displayed when the user requests an augmented reality service including the relevant Sungnyemun branch.

The augmented reality memo advertisement unit 420 displays a memo advertisement for disclosure to all users when displaying an augmented reality screen, or more precisely, it is desirable for the icon of the memo advertisement to be displayed on the screen, but the screen is similar to a smartphone. For small devices, readability may be reduced. Therefore, the presence of memo advertisements can be shown through various types of icons and numbers can be displayed so that users can know how many memo advertisements are in the same location. Of course, since these UI screens can have various forms, embodiments of the present invention will not be particularly limited to any one form.

In addition, the augmented reality memo advertisement unit 420 can allow users to grant access rights when setting a memo advertisement at a specific location, taking into account issues such as readability. For example, while granting access rights, a user name or phone number for the user terminal device 100 can be registered. Therefore, when requesting an augmented reality service from the user terminal device 100, the user's service convenience can be increased by checking the corresponding access authority and providing a memo advertisement based on this. For example, if all three people who have been granted access rights as above are within the designated range of the location where the memo advertisement is set, the augmented reality memo advertisement unit 420 will position the remaining two when one of the three people requests an augmented reality service. After confirming the location, you can provide a memo advertisement to that one person based on the confirmation result. By using access rights in this way, the user's service convenience can be improved.

Of course, the augmented reality memo advertising unit 420 performs various operations in addition to the above. For example, when a user sets up a memo advertisement, he or she sets it so that only the memo advertisement he or she has set can be viewed in augmented reality. In this case, when the user is located within the designated range of the location where the memo advertisement is set, the augmented reality memo advertisement unit 420 may notify the user's user terminal device 100 of a notification. Figure 2 shows this. It notifies the presence of memo advertisements set by the user in various forms such as ringtones or vibration. Of course, memo advertisements here can take various forms, such as general memos. For example, assuming that a user needs to visit an outlet and purchase a specific product, the user can set a text-type memo, but can also set it in the form of a video. Therefore, the user who set up the memo will receive a notification around the time of arrival at the location, and through this, the user will be able to solve the problem of forgetting the purchased item by selecting the memo advertisement and checking the memo or video upon arriving at the location.

In this way, the augmented reality memo advertisement unit 420 can check not only the memo advertisement set by the user but also the memo advertisement set by others. For example, it can check the memo advertisement set by an acquaintance. For example, if the contact information of the acquaintance is stored in the user's terminal device 100, a memo advertisement may be provided based on this information. For example, a memorial memo is a representative example. If an accident occurs at a specific location, if you have written an augmented reality memo that can be recorded forever rather than a physical memo, your acquaintances can also check it. Of course, since the access authority to the memorial memo is an acquaintance, when the user who wishes to commemorate the location shows the location through the augmented reality camera, the augmented reality memo advertisement unit 420 displays the memorial memo advertisement on the contact information of the user terminal device 100. You can provide a memo advertising service by checking whether the contact information of the acquaintance you have set is available. Of course, when requesting an augmented reality service at that location, a pop-up window will ask you if you are an acquaintance, and you will be asked to enter your acquaintance's phone number, name, or various information. The information provided through this will be checked, and the service will be provided according to the verification results. Anything is possible.

The storage unit 430 can temporarily store various types of data processed under the control of the control unit 410 of FIG. 4. For example, when users set up a memo advertisement through the user terminal device 100, the storage unit 430 may temporarily store data related to the memo advertisement and then provide the data to the augmented reality memo advertisement unit 420. Accordingly, the augmented reality memo advertisement unit 420 can perform a data construction operation to provide an augmented reality memo advertisement service. The augmented reality memo advertisement unit 420 can create a memo advertisement requested by the user in a designated format and store it in the DB 120a of FIG. 1.

In addition to the above, the communication interface unit 400, control unit 410, augmented reality memo advertising unit 420, and storage unit 430 of FIG. 4 can perform various operations, and other details have been sufficiently explained previously. I would like to replace it with those contents.

The communication interface unit 400, control unit 410, augmented reality memo advertising unit 420, and storage unit 430 of FIG. 4 according to an embodiment of the present invention are composed of hardware modules that are physically separated from each other, but each module will be able to store software to perform the above operations internally and execute it. However, the software is a set of software modules, and each module can be formed as hardware, so there will be no particular limitation on the configuration of software or hardware. For example, the storage unit 430 may be hardware, such as storage or memory. However, since it is possible to store information through software (repository), the above content will not be specifically limited.

Meanwhile, as another embodiment of the present invention, the control unit 410 may include a CPU and memory, and may be formed as a single chip. The CPU includes a control circuit, an arithmetic unit (ALU), an instruction interpretation unit, and a registry, and the memory may include RAM. The control circuit performs control operations, the operation unit performs operations on binary bit information, and the command interpretation unit includes an interpreter or compiler, which can convert high-level language into machine language and machine language into high-level language. , the registry may be involved in software data storage. According to the above configuration, for example, at the beginning of the operation of the augmented reality memo advertising device 120, the program stored in the augmented reality memo advertising unit 420 is copied, loaded into memory, that is, RAM, and then executed to perform data operation. Processing speed can be quickly increased. In the case of deep learning models, they can be loaded into GPU memory rather than RAM and executed by accelerating the execution speed using GPU.

Figure 5 is a flowchart of a location-based augmented reality memo advertising method according to an embodiment of the present invention.

For convenience of explanation, referring to FIG. 5 together with FIG. 1, the user terminal device 100 selects an online virtual location corresponding to a random location in the real world and sets a memo to notify users, and designates a random location. If it is within the user terminal device 100, the (pre)set memo is displayed on the screen in augmented reality to the user who set the memo or to another user (S500). At this time, the number of memo advertisements displayed on the screen, such as memo advertisements, displayed in augmented reality form may be limited depending on the screen size of the user terminal device 100, but the UI screen is formed in various forms to display as many memos as possible. You can notify users that there are advertisements. For example, the icon of the memo ad type of the user who first set up a memo ad in the same location is displayed, or in the case of paid services, the memo ad of the user who paid the highest cost (e.g. bidding, etc.) is augmented with a representative memo ad. A representative form can be seen as showing it on a real screen and notifying that there are other user's memo advertisements around it, for example, in parentheses.

In addition, the augmented reality memo advertising device 120 checks the access rights of the preset memo when the user terminal device 100 is within the specified range of the location where the memo advertisement is set, and sends the user terminal device 100 to the user terminal device 100 based on the confirmation result. Pre-set notes are provided in augmented reality (S510). Here, access rights are provided when the user designates accessible users when setting up a memo advertisement, and when the service is provided when the user is an acquaintance by checking the contact information in the user terminal device 100 of the user requesting the augmented reality service. etc. are representative examples. In addition, a password can be used for access rights, and for automatic authentication, it can be determined whether the users' user terminal devices 100 are all confirmed within the specified range of the location where the memo is set.

In addition, the augmented reality memo advertisement device 120 can provide a memo advertisement on the screen of the memo advertisement when the user selects the icon for accessing the memo advertisement on the augmented reality screen, and at this time, chat with the user who set the memo advertisement. You can display a chat button that enables . In other words, based on the memo, the memo writer and the user can move to a chat room for chatting. Of course, rather than messenger-based chatting, it is possible to allow users to communicate with each other through comments depending on whether comments are allowed in the memo, so the embodiment of the present invention will not be specifically limited to chatting or comment services.

In addition to the above, the user terminal device 100 and the augmented reality memo advertising device 120 of FIG. 1 can perform various operations, and other details have been sufficiently explained above, so these will be replaced.

Those skilled in the art to which the present invention pertains will understand that the present invention can be implemented in other specific forms without changing its technical idea or essential features. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive. The scope of the present invention is indicated by the claims described below rather than the detailed description above, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present invention. do.

Meanwhile, even though all the components constituting the embodiment of the present invention are described as being combined or operating in combination, the present invention is not necessarily limited to this embodiment. That is, as long as it is within the scope of the purpose of the present invention, all of the components may be operated by selectively combining one or more of them. In addition, although all of the components may be implemented as a single independent hardware, a program module in which some or all of the components are selectively combined to perform some or all of the combined functions in one or more pieces of hardware. It may also be implemented as a computer program having. The codes and code segments that make up the computer program can be easily deduced by a person skilled in the art of the present invention. Such computer programs can be stored in non-transitory computer readable media and read and executed by a computer, thereby implementing embodiments of the present invention.

Here, a non-transitory readable recording medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. . Specifically, the above-described programs may be stored and provided on non-transitory readable recording media such as CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, etc.

In the above, preferred embodiments of the present invention have been shown and described, but the present invention is not limited to the specific embodiments described above, and may be used in the technical field to which the invention pertains without departing from the gist of the invention as claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be understood individually from the technical idea or perspective of the present invention.

100: User terminal device
110: communication network
120: Augmented reality memo advertising device
400: Communication interface unit
410: Control unit
420: Augmented reality memo advertising department
430: storage unit

Claims (10)

A memo is set to notify users by selecting an online virtual location corresponding to a random location in the real world, and if it is within the specified range of the random location, the memo is augmented to the user who set the memo or to other users. A plurality of user terminal devices displayed on the screen in reality (AR) form; and
An augmented reality memo advertising device that checks access rights to the set memo when the user terminal device is within the specified range and provides the set memo in augmented reality form to the user terminal device based on the confirmation result,
The augmented reality memo advertising device,
If access rights are granted to a plurality of other users who can check the set memo, access to the set memo is permitted when the locations of the user terminal devices owned by the plurality of other users are all confirmed within the specified range. do,
As the access right, if the contact information of the user who set the memo exists in the contact information stored in the user terminal device of another user, access to the set memo is permitted,
When the set memo is selected on the augmented reality screen on the user terminal device of another user, the memo contents of the set memo are displayed on the screen and a chat button for conversation with the user who set the memo is also displayed. and provides a comment service that allows you to comment on the memo set above,
A location-based augmented reality memo advertising service system that notifies notifications related to the set memo when the user terminal device of the user who set the memo is within the designated range. delete delete delete delete A plurality of user terminal devices select an online virtual location corresponding to a random location in the real world and set a memo to notify users, and if it is within a specified range of the random location, the user terminal device sets the memo. Displaying the set memo on a screen in augmented reality (AR) form to one user or another user; and
The augmented reality memo advertising device checks access rights to the set memo when the user terminal device is within the specified range and provides the set memo in augmented reality form to the user terminal device based on the confirmation result. Contains,
The steps provided above are:
If access rights are granted to a plurality of other users who can check the set memo, access to the set memo is permitted when the locations of the user terminal devices owned by the plurality of other users are all confirmed within the specified range. do,
As the access right, if the contact information of the user who set the memo exists in the contact information stored in the user terminal device of another user, access to the set memo is permitted,
When the set memo is selected on the augmented reality screen on the user terminal device of another user, the memo contents of the set memo are displayed on the screen and a chat button for conversation with the user who set the memo is also displayed. and provides a comment service that allows you to comment on the memo set above,
A location-based augmented reality memo advertising service method that notifies a notification related to the set memo when the user terminal device of the user who set the memo is within the designated range. delete delete delete delete