KR102533362B1 - Method of Providing Augmented Reality-based Service for Preview of Items for Sale, and Management Server Used Therefor - Google Patents

Abstract

Disclosed are an augmented reality-based method of providing a preview service for sale items and a management server used therein. The present invention is implemented through a process in which a management server receives a photographed image of an article for sale from a seller terminal and generates content for previewing an item based on augmented reality based on the photographed image of the article for sale. According to the present invention, an individual seller who sells products through an e-commerce platform such as an open market can provide users with content for previewing augmented reality-based products for their products, so that products through the e-commerce platform can be provided. It can promote the activation of transactions. In addition, according to the present invention, it is possible to effectively manage the quality of augmented reality-based product preview content provided for various products sold through an e-commerce platform.

Description

Method of Providing Augmented Reality-based Service for Preview of Items for Sale, and Management Server Used Therefor}

The present invention relates to a method for providing a preview service for sale items based on augmented reality and a management server used therein, and more particularly, to an individual seller who sells items through an e-commerce platform such as an open market. By being able to provide augmented reality-based product preview content to users, it is possible to activate product transactions through the e-commerce platform, as well as augment the The present invention relates to a method for providing an augmented reality-based product preview service for effectively managing the quality of content for previewing a product based on reality, and a management server used therefor.

As the spread of various smart devices such as smart phones and smart glasses is expanding, augmented reality (AR) services through smart devices are being attempted in various fields such as education, games, and e-commerce.

Specifically, in the case of a business operator specializing in online sales of only specific products such as furniture, an augmented reality service is provided that allows a user to indirectly experience a state in which an item selected by a user is placed in a user's real space.

However, in the case of an online platform such as an open market where multiple sellers register their products, it is not only difficult for individual sellers to directly produce content for the augmented reality experience for their goods, but also There is a limitation that integrated management of the quality of augmented reality content is difficult.

Publication No. 10-2020-0047903 (2020.05.08.)

Accordingly, an object of the present invention is to enable an individual seller who sells products through an e-commerce platform such as an open market to provide users with augmented reality-based product preview content for their sales products, thereby providing an e-commerce platform. Not only can it be possible to promote product transactions through e-commerce platforms, but also to effectively manage the quality of the augmented reality-based product preview content provided for various products sold through the e-commerce platform. It is to provide a sales product preview service providing method and a management server used therein.

The problem to be solved by the present invention is not limited to the above-mentioned problem, and includes other technical problems that can be clearly understood by those skilled in the art from the following description.

To achieve the above object, a method for providing a preview service for sale items based on augmented reality according to the present invention includes: (a) receiving, by a management server, a photographed image of an item for sale from a seller terminal; and (b) generating, by the management server, augmented reality-based content for product preview based on the photographed image of the product for sale.

Preferably, the method further includes (c) transmitting, by the management server, the content for previewing the augmented reality-based article to a searcher terminal.

On the other hand, the management server according to the present invention, the receiving unit for receiving a photographed image of the sale item from the seller terminal; and a calculation unit generating augmented reality-based content for product preview based on the photographed image of the product for sale.

Preferably, the apparatus further includes a transmitter configured to transmit the content for previewing the augmented reality-based article to a searcher terminal.

According to the present invention, an individual seller who sells products through an e-commerce platform such as an open market can provide users with content for previewing augmented reality-based products for their products, so that products through the e-commerce platform can be provided. It can promote the activation of transactions.

In addition, according to the present invention, it is possible to effectively manage the quality of augmented reality-based product preview content provided for various products sold through an e-commerce platform.

The effects of the present invention are not limited to the mentioned effects, and include other effects that can be clearly understood by those skilled in the art from the following description.

1 is a block diagram of an augmented reality-based product preview service providing system for sale according to an embodiment of the present invention;
2 is a functional block diagram showing the structure of a management server that executes an augmented reality-based sales product preview service providing method according to an embodiment of the present invention; and
3 is a signal flow diagram illustrating an execution process of a method for providing a preview service for sale items based on augmented reality according to an embodiment of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings. It should be noted that like elements in the drawings are indicated by like numerals wherever possible. In addition, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention will be omitted.

1 is a block diagram of a system for providing a preview service for sale goods based on augmented reality according to an embodiment of the present invention. Referring to FIG. 1 , a system for providing a preview service for sale goods based on augmented reality according to an embodiment of the present invention includes a searcher terminal 100, a management server 200, and a seller terminal 300, and includes a service A providing server 400 may be additionally included.

The management server 200 is a server operated by an e-commerce platform operator such as an open market that mediates the sale of various items such as food and furniture online. Augmented reality-based product preview content for the corresponding product is provided to the searcher.

The seller terminal 300 is a communication terminal such as a smart phone or PC possessed by a seller who sells goods through an e-commerce platform provided by the management server 200, and the seller terminal 300 according to the present invention A predetermined seller application program required to use the augmented reality-based sales product preview service may be installed.

The searcher terminal 100 is a communication terminal such as a smart phone or PC possessed by a searcher who accesses the management server 200 to search for sale product information in order to purchase a product. A predetermined application program for a searcher required to use the augmented reality-based sales product preview service according to the present invention may be installed.

Meanwhile, in the present invention, 3D modeling data of an item is generated based on a photographed image of a seller's item for sale, and content for previewing an item based on augmented reality is generated using the generated 3D modeling data. The process of generating content for product preview may be executed in the seller terminal 300, in the management server 200, or in the service providing server 400 that receives the content creation request from the management server 200. will be.

2 is a functional block diagram showing the structure of a management server 200 that executes an augmented reality-based method of providing a preview service for sale items according to an embodiment of the present invention. Referring to FIG. 2 , the management server 200 that executes the augmented reality-based product preview service providing method according to an embodiment of the present invention includes a receiving unit 210, a storage unit 230, a calculation unit 250, and a transmitter 270.

The receiving unit 210 of the management server 200 receives a photographed image of an article for sale from the seller terminal 300, and previews the augmented reality-based article generated by the service providing server 400 from the service providing server 400. Content is received and an article search request is received from the searcher terminal 100 .

Meanwhile, the calculation unit 250 of the management server 200 generates augmented reality-based content for previewing the product based on the captured image of the product for sale received from the seller terminal 300 .

The transmitting unit 270 of the management server 200 transmits a content generation request for previewing augmented reality-based articles to the service providing server 400, and previews augmented-reality-based articles stored in association with product information searched by a searcher. Content is transmitted to the searcher terminal 100 .

Meanwhile, various received information from the receiver 210, various calculation information from the calculation unit 250, and various transmission information from the transmission unit 270 are accumulated and stored in the storage unit 230.

3 is a signal flow diagram illustrating an execution process of a method for providing a preview service for sale items based on augmented reality according to an embodiment of the present invention. Hereinafter, with reference to FIGS. 1 to 3 , an execution process of a method for providing a preview service for sale goods based on augmented reality according to an embodiment of the present invention will be described.

First, the seller photographs his or her sales items, such as food and furniture, to be sold through an e-commerce platform such as an open market provided by the management server 200 (S510), and then captures the product image and the management server 200 A photographed image registration request including the identification number of the corresponding item already registered in is transmitted to the management server 200 through the seller terminal 300 (S520).

Accordingly, the management server 200 searches for corresponding product-related information pre-registered in the management server 200 based on the product identification number included in the photographed image registration request received from the seller terminal 300, and related to the searched product. The item photographed image is associated with the information and stored (S530).

Meanwhile, the management server 200 may transmit a content generation request for previewing an augmented reality-based product including an item photographed image received from the seller terminal 300 to the service providing server 400 (S540).

Accordingly, the service providing server 400 generates 3D modeling data of the corresponding item based on the photographic image of the item received from the management server 200, and uses the generated 3D modeling data to generate augmented reality-based content for previewing the item. Do (S550).

Specifically, the service providing server 400 calculates actual size information of the item based on scale information included in the item photographed image when generating 3D modeling data of the corresponding item based on the item photographed image, and calculates the size of the product. By generating 3D modeling data of the same size as the information, it is possible to maximize the realism of the product experience provided through content for previewing the product based on augmented reality.

Meanwhile, in implementing the present invention, scale information of the captured image input by the seller may be included in the request for registering the captured image in step S520 and the request for content generation in step S540 described above.

The management server 200 receives the augmented reality-based product preview content generated in this way from the service providing server 400 (S560), and transmits the received content to the management server 200 in relation to the corresponding product. It is stored in association with product information (S570).

On the other hand, in carrying out the present invention, the management server 200 that has received the content for previewing augmented reality-based products from the service providing server 400 is the real object of the photographed image received from the seller terminal 300 in step S520. Based on the contrast scale information, it is determined whether the size and ratio of the 3D modeling data included in the content match the actual product, and if it is determined to match, the content is associated with the storage unit 230 as product-related information. stored, and if it is determined that they do not match, a content modification request including scale information of the captured image may be transmitted to the service providing server 400 .

In addition, in carrying out the present invention, the management server 200 previews the augmented reality-based article including the content before associating and storing the content for previewing the augmented reality-based article generated as described above in the storage unit 230. A content registration approval request may be transmitted to the seller terminal 300 .

Accordingly, when the seller confirms the contents of the content received from the management server 200 and selects 'approval' on the seller terminal 300, the management server 200 receives a registration approval message from the seller terminal 300 The management server 200 may associate and store the corresponding content in the storage unit 230 .

On the other hand, in this case, if the seller who has confirmed the contents of the content determines that the size or ratio of the 3D modeling data of the product provided through the content is different from the actual product, the size enlargement / reduction of the 3D modeling data, 3 of the 3D modeling data A content modification request such as axis ratio adjustment may be input to the seller terminal 300 so that the corresponding modification request is transmitted to the management server 200 .

Accordingly, the calculation unit 250 of the management server 200 executes a modification process for the corresponding content based on the content modification request received from the seller terminal 300, and then stores it in the storage unit 230 in association with the corresponding product information, thereby augmenting the content. It will be possible to maximize the realism of the product experience provided through the content for previewing the product based on reality.

Thereafter, the management server 200 receives an item search request for the corresponding item from the searcher terminal 100 (S580), and searches for corresponding item-related information and contents for previewing augmented reality-based items stored in connection therewith. It is transmitted to the user terminal 100 (S590).

Meanwhile, in implementing the present invention, the management server 200 transmits product information in which content for previewing an augmented reality-based product is relatedly stored to the searcher terminal 100 at the request of the searcher on the search result screen. By placing it first in the exposure ranking, sales of items that can be previewed based on augmented reality may be further encouraged.

Accordingly, a searcher can indirectly experience an item to be purchased in a space where he or she is currently located through augmented reality-based item preview content provided from the management server 200, thereby more efficiently determining whether or not to purchase the corresponding item.

On the other hand, in carrying out the present invention, evaluation information (e.g., augmented reality-based content for previewing an augmented reality product provided from the management server 200 in the above-described step S590 after a searcher who has purchased the corresponding item checks the actual delivered item). For example, it seems that the size of the product is a little smaller than that seen in the preview! etc.) may be input into the searcher terminal 100.

Accordingly, the management server 200 may transmit a content modification review request including the corresponding evaluation information received from the searcher terminal 100 to the seller terminal 300 .

Accordingly, the seller who has confirmed the evaluation information of the searcher may input a content modification execution request, such as enlarging/reducing the size of 3D modeling data and adjusting the 3-axis ratio of 3D modeling data, through the seller terminal 300, and thus the management server 200 ) executes a modification process for the corresponding content based on the content modification execution request received from the seller terminal 300. By updating and storing the modified content in the storage unit 230, it is possible to maximize the realism of the product experience provided through the content for previewing the product based on augmented reality.

Meanwhile, in carrying out the present invention, in generating content for previewing an augmented reality-based product in step S550 described above, the management server 200 does not transmit a content creation request to the service providing server 400, but the management server ( The operation unit 250 of 200) may directly generate augmented reality-based product preview content, and in this case, the aforementioned steps S540 and S560 will not be executed.

In addition, in carrying out the present invention, in generating the augmented reality-based product preview content in step S550 described above, the augmented reality-based product preview that the seller terminal 300 receives from the management server 200 and installs. It is also possible to directly create content using a content creation application program and a photographed image of a product for sale, and transmit a content registration request including the created content to the management server 200. In this case, the above-described steps S520 to Step S560 will not be executed.

In addition, in carrying out the present invention, the seller changes the color and/or size of the product in the augmented reality-based product preview content previously registered in the management server 200 and changes the content for the new product released. In the case of additional registration in the management server 200, color change information and/or size change information and new product-related information together with selection information for augmented reality-based product preview content previously registered in the management server 200 A request for generating additional content including information may be transmitted to the management server 200 through the seller terminal 300 .

In this case, the calculation unit 250 of the management server 200 searches for augmented reality-based product preview content selected by the seller, and then applies color change information and/or size change information to the searched content to preview a new product. By additionally generating content for a new product, it is possible to generate augmented reality-based product preview content for a new product while minimizing a workload such as generating 3D modeling data for the new product.

In addition, in carrying out the present invention, the program for executing the augmented reality-based sales product preview service providing method according to the present invention is installed in the management server 200 according to the present invention or stored in various computer-readable recording media. It may be recorded or stored on a server that transmits the program through a network.

The order between the above steps (S510 to S590) is only an example, and is not limited thereto. That is, the order of the above-described steps (S510 to S590) may be mutually changed, and some of the steps may be simultaneously executed or deleted.

Terms used in the present invention are only used to describe specific embodiments and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, the terms "include" or "have" are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Although preferred embodiments and application examples of the present invention have been shown and described above, the present invention is not limited to the specific embodiments and application examples described above, and the present invention is not departing from the gist of the present invention claimed in the claims. Various modifications and implementations are possible by those skilled in the art, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

100: searcher terminal, 200: management server,
300: Merchant terminal, 400: Service providing server.

Claims (4)

(a) receiving, by a management server, a photographed image registration request including a photographed image of an article for sale and scale information of the photographed image from a seller terminal;
(b) generating, by the management server, augmented reality-based content for product preview based on the photographed image of the product for sale;
(c) determining, by the management server, whether the size and ratio of the 3D modeling data included in the augmented reality-based product preview content and the sale product match, based on scale information of the captured image;
(d) transmitting, by the management server, a content registration approval request including the augmented reality-based product preview content to the seller terminal;
(e) receiving, by the management server, a modification request for the 3D modeling data from the seller terminal;
(f) executing, by the management server, a modification process for the content for previewing the augmented reality-based article based on a modification request for the 3D modeling data;
(g) transmitting, by the management server, the modified content for previewing the augmented reality-based product to a searcher terminal that has searched for the sale product; and
(h) receiving, by the management server, evaluation information obtained by comparing the sale product delivered to the searcher with the augmented reality-based product preview content from the searcher's terminal;
Augmented reality-based sales item preview service providing method comprising a.
According to claim 1,
(i) Sending, by the management server, a content modification review request including the evaluation information received from the searcher terminal to the seller terminal.
a receiving unit receiving a request for registering a photographed image including a photographed image of an article for sale and scale information of the photographed image from a seller terminal;
Based on the photographed image of the article for sale, augmented reality-based product preview content is generated, and based on scale information of the captured image, the item for sale of 3D modeling data included in the augmented reality-based product preview content. a calculation unit that determines whether the size and ratio of the values match; and
A transmitter for transmitting a content registration approval request including the augmented reality-based product preview content to the seller terminal.
Including,
The reception unit receives a modification request for the 3D modeling data from the seller terminal,
The operation unit executes a modification process for the contents for previewing the augmented reality-based article based on a modification request for the 3D modeling data;
The transmission unit transmits the modified augmented reality-based content for previewing the product to a searcher terminal that has searched for the sale product;
The management server, wherein the receiving unit receives, from the searcher terminal, evaluation information obtained by comparing the sales product delivered to the searcher with the augmented reality-based product preview content.
According to claim 3,
The management server, wherein the transmitting unit transmits a content modification review request including the evaluation information received from the searcher terminal to the seller terminal.

Images