KR20120134054A - Apparatus for processing user annotations and electronic book service system for the same - Google Patents

Abstract

Disclosed is a user annotation processing apparatus that can realistically implement user annotation in a three-dimensional e-book that a user can intuitively recognize. According to one embodiment of the device, the size of the bookmark to be inserted into the e-book based on the size of the text on the screen, the position of the bookmark on the side of the e-book, and then displays the bookmark on the e-book . According to another embodiment, after determining the size and position of the marker based on the shape of the marker indicating that there is a memo inserted in the e-book and the distance between the objects between the lines, the marker is displayed on the e-book. According to another embodiment, the thickness of the pen to be displayed in the e-book is determined based on the thickness of the at least one pen among the highlighter, the scribing pen, and the free doodle pen, the width of the pixel, and the screen magnification. In addition, at least one user annotation of the highlighter, underline, and free graffiti processed on a predetermined portion of the e-book is displayed on the e-book.

Description

A device for annotating a user and an e-book service system and method therefor {APPARATUS FOR PROCESSING USER ANNOTATIONS AND ELECTRONIC BOOK SERVICE SYSTEM FOR THE SAME}

The present invention implements a user annotation on an e-book including a plurality of electronic documents, and allows the user to integrate and search the user annotation implemented in his or her entire e-book regardless of the device.

In the present invention, an e-book includes an electronic document (eg, a doc document, a PowerPoint (ppt) document, a pdf document, etc.) having a multi-stage layout, and the single-page document composed of one end includes letters, tables, drawings, It consists of formulas, chemical formulas and the like.

Recently, with the development of multimedia technology, a great deal of information has been digitized, and due to the development of various digital input devices and storage devices, a large amount of multimedia data is being produced. In addition, the proliferation of the Internet plays a large role in helping the quantitative expansion of multimedia. Due to the development of multimedia technology and the spread of the Internet, the use of electronic books including electronic documents is increasing.

In general, users write their own information in a paper book or paper document, such as 'add bookmarks to a page so that you can easily see the pages you see most often' (bookmark function), Paste on a specific page (note function), mark on a specific area with a highlighter pen (highlight pen function), underline a specific part (line break function), write on the paper, i.e. Drawing ”(free doodle function). The user annotation can be processed in the same way as an e-book including an electronic document, thereby increasing user convenience.

By the way, when the e-book is displayed on the screen, the conventional e-book is displayed like a one-page document on a plane (although the actual paper book is three-dimensional solid). E-books, unlike paper books, use a method similar to displaying a single document on a two-dimensional plane. That is, the e-book is actually composed of several pages, similar to a paper book, but is displayed on the screen in a two-dimensional form that looks like a single document as shown in FIG.

In addition, at first glance, there are e-books that are displayed in three-dimensional form instead of two-dimensional, but if you look closely, they do not actually implement the three-dimensional form properly. That is, referring to FIG. 2, the number of pages of the e-book displayed on the left and the e-book displayed on the right differ greatly, but the thickness and pattern of the right side portion of each e-book are displayed the same. And, as a reading book increases, the number of pages increases as the reading progresses. If the book is read from left to right, the thickness of the left side of the book becomes thicker and the thickness of the right side becomes thinner, but the e-book in PDF or EPUB format The thickness of the left and right sides is displayed uniformly. That is, although the left and right thicknesses of the unfolded book vary as the current reading position changes, the e-book can be confirmed through FIG. 2 that the left and right thicknesses remain unchanged. In FIG. 2, the left side shows an ebook in EPUB format on iPAD, and the right side shows an ebook in EPUB format on iPhone. In addition, although the pattern of the unique pattern is slightly different for each book on the side part of the paper book, the e-books can be seen in FIG. 2.

In addition, referring to Figure 3, even though the page position of the current book is the front cover, looking at the side portion causes an illusion as if looking at the center of the book. At first glance, these e-books appear to be three-dimensional e-books, but in reality there is a problem that causes great confusion for the user's intuition (ie, is unintuitive).

Particularly, when user annotations (bookmarks, memos, highlighters, line breaks, free doodles, etc.) are uniformly processed on non-intuitive e-books, the realism is lower than that of user annotations on paper books. Moreover, e-books do not support user annotation features such as bookmarks, memos, highlighters, line breaks, and free graffiti, and only support some functions.

Therefore, a three-dimensional codex format e-book with the same ratio (or even typeface) of a paper book and a horizontal-vertical-thickness distribution ratio, page layout, and the like is implemented. If it supports the same user annotation function as the paper book, the user's convenience, which is a natural effect of the user annotation, can be increased in addition to the realism of the paper book.

In addition, in the conventional e-book service system, devices with different user annotations individually processed by arbitrary Internet-enabled devices (for example, MS Windows-based computer, Mac OS X-based computer, iOS-based terminal, Android-based terminal, etc.) You will not be able to consolidate and search all eBooks shared by or purchased or loaned by individual users. That is, in the conventional e-book service system, only user annotations can be searched for a single e-book. Therefore, if there are 100 types of e-books currently owned by the user, for example, purchased or loaned e-books, the user can add specific annotations (for example, insert bookmarks, If you can not remember whether you've done a fill-in, marking with a highlighter, underlining a specific part, or writing a pen directly on the page, or writing or drawing, There is an inconvenience in that a search must be performed by opening the database.

Korean Laid-Open Patent Publication No. 10-2001-0061340 (published Jul. 7, 2001)

An object of the present invention is to provide a user annotation processing apparatus that can realistically implement a user annotation in a three-dimensional e-book that the user can intuitively recognize.

In addition, another object of the present invention is an e-book service system and method that allows a user to integrate and search user annotations implemented in their entire e-book (e-books purchased or loaned by individual users) regardless of the device To provide.

According to an aspect of the present invention, a user annotation processing apparatus that can realistically implement a user annotation in a three-dimensional e-book that the user can intuitively recognize. According to one embodiment of the device, the size of the bookmark to be inserted into the e-book based on the size of the text on the screen, the position of the bookmark on the side of the e-book, and then displays the bookmark on the e-book . According to another embodiment, after determining the size and position of the marker based on the shape of the marker indicating that there is a memo inserted in the e-book and the distance between the objects between the lines, the marker is displayed on the e-book. According to another embodiment, the thickness of the pen to be displayed in the e-book is determined based on the thickness of the at least one pen among the highlighter, the scribing pen, and the free doodle pen, the width of the pixel, and the screen magnification. In addition, at least one user annotation of the highlighter, underline, and free graffiti processed on a predetermined portion of the e-book is displayed on the e-book.

According to another aspect of the present invention, an e-book service system and method for allowing a user to integrate and search user annotations implemented in their entire e-books (e-books purchased or loaned by individual users) regardless of the device This is disclosed. According to this system and method, a unique number of an entire e-book is stored in a database management system (DBMS), and annotation information processed in the e-book for each user and storage time information in which the annotation information is stored are unique to the e-book in the personalization area. Manage by mapping to numbers. In response to the annotation search request, the corresponding annotation information mapped to the e-book unique number of the personalization area is retrieved from the DBMS and provided. Further, the e-book is distinguished based on the unique number, and the annotation information is synchronized based on the storage time information.

According to the present invention, an electronic book including an electronic document has an advantage that the user annotation can be realistically implemented as in a paper document or a paper book.

In addition, the present invention has the advantage of implementing a three-dimensional codex (e-book) in the form of e-books, and in the three-dimensional intuition e-books support the same user annotation function as the paper book to increase user convenience.

In addition, the present invention has the advantage that the user annotation processed in some devices can be synchronized to other devices.

In addition, the present invention has the advantage that can be searched by integrating user annotations implemented in their entire e-books (e-books purchased or loaned by individual users) regardless of the device.

In addition, the present invention has the advantage of protecting the privacy of the individual from the risk of hacking by transmitting encrypted by transmitting the user annotation for synchronization.

1 to 3 is a view showing a conventional e-book.
4 schematically illustrates the configuration of an exemplary e-book service system in which the present invention may be practiced.
5 is a diagram illustrating a configuration of a user terminal according to an embodiment of the present invention.
6 is a view showing a display conversion process using a two-dimensional graphics function according to an embodiment of the present invention.
7 is a view showing a display conversion process using a three-dimensional graphics function according to an embodiment of the present invention.
8 to 10 are views showing a state in which the read mode image is displayed through the user terminal according to an embodiment of the present invention.
11 is a diagram showing the configuration of a user annotation processing apparatus according to an embodiment of the present invention.
12 illustrates an e-book with a bookmark inserted according to an embodiment of the present invention.
13 and 14 are views showing an example in which the user sets the font size according to an embodiment of the present invention.
15 is a view showing a side portion of the book lying at an angle in accordance with an embodiment of the present invention.
16 is a view showing a bookmark inserted into the side portion of the book lying at an angle in accordance with an embodiment of the present invention.
17 is a diagram illustrating a process of inserting a memo into an e-book according to an embodiment of the present invention.
18 is a view showing the shape, size and position of the marker indicating that there is a memo according to an embodiment of the present invention.
19 is a view showing an example of implementing a line break function in an e-book according to an embodiment of the present invention.
20 illustrates an example of implementing a free doodle function in an e-book according to an embodiment of the present invention.
21 is a view showing an example of implementing a highlighter function in an e-book according to an embodiment of the present invention.
22 is a flowchart illustrating a procedure for synchronizing user annotations according to an embodiment of the present invention.
23 is a flowchart illustrating a procedure for retrieving user annotations in accordance with an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the following description, well-known functions or constructions will not be described in detail if they obscure the subject matter of the present invention.

4 is a diagram schematically illustrating a configuration of an exemplary e-book service system in which the present invention may be implemented.

As shown in FIG. 4, the e-book service system environment 100 stores unique numbers of all e-books (e-books in the personalization area and e-books in the non-personalization area), and annotation information processed in the e-book for each user. And a database management system (DBMS) 120 for mapping and managing the storage time information in which the annotation information is stored to the e-book unique number of the personalization area, and in response to the annotation retrieval request, the DBMS 120 displays the electronic information of the personalization area. A search server 130 for searching and providing corresponding annotation information mapped to a book unique number, and an annotation synchronization server 140 for distinguishing an e-book based on the unique number and synchronizing the annotation information based on the storage time information. Include.

Here, the annotation search request may be a name (annotation name) of a comment arbitrarily input by a user during annotation processing, or may be a request for all annotation information processed by a user annotation among e-books in the personalization area. E-books purchased or loaned by users are called 'e-books in the personalization area', and other e-books in the e-book library are called 'e-books in the non-personalization area'.

In addition, the e-book service system environment 100 displays the e-book in three dimensions so that the user can intuitively recognize the user's terminal (the e-book displayed as a three-dimensional codex format e-book). 110 may further include. The user terminal 110 displays an e-book in a 3D codec format that the user can intuitively recognize. A process of displaying an e-book in 3D codec format will be described later.

When the user executes the e-book application in the terminal 110, the user terminal 110 attempts to access the annotation synchronization server 140.

The annotation synchronization server 140 controls the synchronization of annotation information in which changes have occurred so that user annotations of the e-book processed by the user terminal 110 can be shared. That is, when the annotation synchronization server 140 browses the e-book purchased or loaned by the user using the various user terminals 1110, the user annotations generated, modified, or deleted on any device are read by all other devices (eg, Synchronize the annotation information so that it can be shared by the user terminals 2 and 3 (110).

In addition, the user terminal 110 is connected to the search server 130 and the database management system (DBMS) 120 through the network 150, the e-book (in this case, e-books are subject to e-books in the personalized and non-personalized areas) Search and user annotations processed in a particular ebook, where the ebook may be an ebook in the personalization area that the user has purchased or loaned. At this time, the retrieval of the user annotation may be annotation information (single annotation information of a single e-book) through direct input of the annotation name, and an annotation list through request of all annotation information processed by the user annotation among e-books in the personalization area. (Single or multiple annotation information of a single or multiple e-books). In one embodiment, when the annotation list is transmitted, basic bibliographic information (eg, author, publisher, title, etc.) stored in the DBMS 120 may be transmitted together.

In one embodiment, the type of the user terminal 110 can be replaced by not only a PC, but also a notebook, a hand-held PC, a PDA, a mobile communication terminal, a portable Internet terminal, a broadcast receiver, a DMB phone, and the like. It should be noted that, as long as possible, the e-book service can be used through any wired or wireless Internet connection using any computing device. In addition, the network 150 may include all wired communication media such as LAN or WAN, and wireless communication media such as WiFi / WiBro and mobile communication systems. For example, it can be any kind of Internet-enabled device, such as an MS Windows-based computer, a Mac OS X-based computer, an iOS-based device, or an Android-based device.

In one embodiment, the user may search the user annotations processed in the e-book as well as the e-book by interworking with the search server 130 through the user terminal 110 and the network 150. At this time, the 'user annotation processed in the e-book' is, e-books purchased or loaned by the user through a certain user terminal 1 (110) through a certain annotation, for example, insert a bookmark, writing a note on a specific page Pasting on, marking a specific area with a highlighter, underlining a specific area, or writing a pen, writing or drawing directly on a page. In addition to the user terminal 1 (110), the user annotations processed in the e-book can be searched for not only a single e-book in the user terminals 2 and 3 (110), but also integrated in the entire e-book purchased or loaned by the user. Search is also possible.

The search server 120 searches for e-books (e-books in the personalization and non-personalization areas), and integrates user annotations processed by the user into all e-books (e-books in the personalization area) purchased or loaned by each user. Search.

That is, the search server 130 may receive a search word (eg, an e-book name, an author name, a text search word, etc.) to be an e-book (ie, an e-book in a non-personalized area and an entire e-book in a personalized area). ) Can be configured to perform a search. At this time, the e-books purchased or loaned by the user from the entire e-books through the search, that is, the e-books in the personalization area, are stored and managed for each user in the DBMS 120.

In addition, the search server 130 may be configured to perform a search (single search or integrated search) of user annotations processed in the electronic book of the personalization area. The user annotation information processed by the user in the electronic book in the personalization area through any user terminal 110 is stored and managed for each user in the DBMS 120. In one embodiment, when a comment name (the name of the comment input by the user in the comment processing) is input from the user terminal 110 to search for the user comment, the search server 130 searches the DBMS 120 for the corresponding comment. Annotation information (single annotation information of a single e-book) is transmitted to the user terminal 110. In another embodiment, when the user terminal 110 receives a request for all annotation information processed by the user annotation among the e-books in the personalization area, the search server 130 inquires the DBMS 120 to display all annotations of the user. An annotation list including information (single or multiple annotation information of a single or multiple e-books) is transmitted to the user terminal 110.

The DBMS 120 stores e-books (e-books in the personalization area) purchased or loaned by individual users through the network 150 for each user, and are processed in a 3D codex format e-book on the user terminal 110. Annotation information (bookmark information, memo information, highlighter information, line drawing information, free doodle information, etc.) is stored and managed for each user.

That is, the DBMS 120 maps the user annotation information processed to the e-books in the personalization area and any of the e-books, and stores and manages them for each user. In one embodiment, the unique number of the e-book and the user annotation information is mapped and managed. In another embodiment, in order to synchronize the annotation information, the DBMS 120 stores the e-book unique number and user annotation information, as well as storage time information in which the annotation information is stored in the DBMS 120 through the annotation synchronization server 120. And, it manages by further mapping the unique number of the user terminal 110, the annotation information processed in the e-book sent.

In another embodiment, when the user terminal 110 executes the e-book application and successfully accesses the annotation synchronization server 140, the annotation synchronization server 140 controls the search server 130 to display the annotation list on the user terminal. Provided by 110. At this time, whether to receive a list of annotations is made by the user.

The user terminal 110 may not only search and integrate the annotation information of the e-book stored in its terminal, but also the annotation information of the e-book stored in the DBMS 120 without being stored in the terminal based on the annotation list. You can also search for the integrated.

In the above, the functions of the DBMS 120 and the search server 130 for storing the user annotation information processed in any of the e-books of the personalization area and the single or integrated search of the user annotation information are stored in the user terminal. The same is also implemented inside 110. A detailed description will be made later with reference to FIG. 5.

Hereinafter, the process of displaying an e-book in the 3D Codex format (FIGS. 6 to 10) will be described. Then, the process of processing the user annotation on the e-book in the 3D Codex format (FIGS. 11 to 21) and the user will be described. The process of synchronizing and retrieving annotations (FIGS. 22 and 23) will be described sequentially.

5 is a diagram illustrating a configuration of a user terminal 110 according to an embodiment of the present invention.

The user terminal 110 includes a storage unit 510, a controller 520, an input unit 530, and a display unit 540.

When the user purchases or loans an e-book, the e-book in the personalization area is stored and managed in the storage unit 510. In addition, the user annotation information processed by the electronic book in the personalization area is also stored and managed in the storage unit 510.

The storage unit 510 stores and manages e-books in the personalization area and user annotation information processed in any of them. In one embodiment, the unique number of the e-book and the user annotation information is mapped and managed. In another embodiment, in order to synchronize the annotation information, the storage unit 510 additionally maps and manages time information for recording the annotation information in the annotation synchronization server 120 together with the e-book unique number and user annotation information. . Accordingly, the controller 520 may perform a search (single search or integrated search) of user annotations processed in the electronic book of the personalization area.

The e-book of the personalization area stored in the storage unit 510 includes an e-book file having a predetermined data structure.

For reference, the e-book file may include a data structure including an image area (e-book image information) showing an entire image of each page, an area of code values of letters existing in each page, and an internal letter area. The image area (e-book image information) of the e-book file according to the embodiment may be an area in which an image, a photo, or a command for allowing a computer to immediately generate an image of each page is actually collected.

Here, the internal text area is a logical area and includes an object including "letter", "image", "table letter", etc. as a minimum unit that constitutes the content of the electronic document. Here, the letter is a meaningful character, and the image includes a photograph, a picture, an equation represented by an image, a table, and the like. A table letter is a letter that describes an image and usually means a hidden letter that is not displayed on the screen. Each object in the e-book file contains "letter code," "letter property" and "coordinates on the screen" information. The character code is a code for displaying the character on the screen of the display unit 540, and the character attribute is information about font of the character, for example, bold, underline, and italics. Further, the coordinate information on the screen includes size information of each letter in the original of the e-book file. You can use this information to keep track of where and what text or images occupy the entire image area of the page. In addition, text search can be performed on tables, photographs, formulas, etc., which are represented in the form of images in e-books such as electronic documents by using table letters.The table letters also have coordinate values on the screen as objects. You can search where it is on the page.

In addition, the internal character area includes a line which is a collection of objects. As described above, the minimum unit constituting the internal character area of the e-book file is an object, which exists on the same horizontal straight line (for writing books) or vertical straight line (for writing books) among these objects. When you collect the objects, it becomes a line. That is, a line represents a set of objects on the same line.

Also, the internal character area includes a group which is a set of predetermined lines. In an e-book, groups can be set up by grouping the lines to which the text content is appropriately linked on each page. In other words, a group represents a set of lines in which the connection of contents naturally proceeds when the contents are read out. For example, the group may set the group by analyzing the coordinate values of the objects included in the at least one line and obtaining a cluster distribution of the at least one object and clustering the clusters by cluster. Here, the group may be similar to the paragraph.

In addition, the internal character area includes a page which is a set of groups. A group can consist of several pages, but a page can also be a group. That is, pages and groups may be the same. However, in order for a page and a group to be the same, the page must be a document with one paragraph. If a page consists of multiple paragraphs, the page must be organized into groups. This is because, in a document composed of multiple paragraphs, there may be lines that exist on the same line but cannot be connected if read as they are. Sequential reading of lines within a group must satisfy the constraint that the content must be correctly concatenated. The internal text area contains a book, which is a collection of pages. That is, the e-book file is stored in the storage unit 510 as a "book> page> group> line> object", that is, a hierarchical structure in the order of book, page, group, line, object.

The above-described image area, that is, the e-book image information may include a left side image, a right side image, a left e-book image, and a right e-book image of the e-book. The left and right side images represent images for displaying the left and right sides of the e-book, and the left and right e-book images can represent left and right images for representing the contents of the contents of the e-book.

The controller 520 may form a read mode image and a fast movement mode image. The reading mode indicates a mode generally used when a user reads an e-book using the user terminal 110, and the quick moving mode is used to quickly move to a desired page of the e-book with a simple operation of the user. Indicates the mode. The controller 520 performs display conversion of the left side image and the right side image included in the e-book image information stored in the storage unit 510, and displays the converted left and right side images and the left and right e-book images. The image may be synthesized to form a read mode image. For example, the control unit 520 performs a perspective transformation, i.e., a display transformation, of the two-dimensional left side image and the right side image included in the electronic book image information stored in the storage unit 510, Can be formed.

Here, two methods of performing display conversion may exist. One is a method using a 2D graphic function supported by an operating system, and the other is a method using a 3D graphic function supported by an operating system. For example, since it is difficult to use a 2D graphical function and a 3D graphical function in combination with a Microsoft Windows (MS-Windows) operating system, the display conversion between the left side image and the right side image Can be performed. Also, since it is convenient to use 2D graphic functions and 3D graphic functions in an operating system such as Mac OS X or iOS, display conversion of the left side image and the right side image is performed based on the 2D graphic function It is advantageous in terms of the screen output speed to represent left and right side images using only three-dimensional graphic functions.

For the sake of understanding, hereinafter, a method of using a 2D graphic function and a method of performing display transformation using a 3D graphic function will be described, and a relation between variables used in the 2D graphic function and the 3D graphic function will be described. This will also be described.

In addition, the controller 520 performs display conversion of the two-dimensional left and right e-book images included in the e-book image information stored in the storage unit 510, and converts the converted left and right e-book images and the e-book. Two-dimensional left and right side images included in the image information may be synthesized to form a fast moving mode image.

The input unit 530 receives a user input and forms an image switching signal for switching an image between the read mode image and the fast moving mode image. For example, the input unit 530 may include a mouse, a touch pad, and the like, but is not limited thereto.

On the other hand, the controller 520 may perform image switching between the read mode image and the fast moving mode image displayed on the display unit 540 when the image switching signal is input. That is, the controller 520 may control to display the fast moving mode image when the image change signal is input while the read mode image is displayed on the display unit 540. In addition, the controller 520 may control to divide the screen of the display 540 into four regions in order to display the fast moving mode image.

The display unit 540 displays the read mode image or the fast moving mode image formed by the controller 520. In addition, the display unit 540 may perform a function of the input unit 530 for receiving a user input, including a touch pad. The display unit 540 may include a cathode ray tube (CRT) display, a liquid crystal display (LCD), an organic light emitting diode (OLED) display, or the like.

6 is a view illustrating a display conversion process using a 2D graphic function according to an embodiment of the present invention.

(Y, V) of the right-trapezoidal three-dimensional image (3D) when a specific position of (X, U) of the left rectangular-shaped 2D image is displayed and converted, , The abscissa Y in the three-dimensional image (3D) can be expressed by the following equation (1).

Here, W represents the length in the horizontal direction in the rectangular two-dimensional image (2D), L1 represents the length in the longitudinal direction in the rectangular two-dimensional image (2D) and the length of the base side in the trapezoidal three-dimensional image (3D) L2 represents the length of the upper side in the trapezoidal three-dimensional image (3D).

Meanwhile, the vertical coordinate V in the 3D image 3D may be expressed as in Equation 2 below.

In order to obtain the pixel information of the image corresponding to the position (Y, V) in the three-dimensional image (3D), the abscissa X value is calculated using Equation 1, the U coordinate value is obtained using Equation 2, (Y, V) of the three-dimensional image (3D) using pixel information corresponding to the (X, U) position of the two-dimensional image (2D). In FIG. 6, it may be assumed that the origin O of the 2D image 2D is a position passing through the center point of the rectangle.

7 is a diagram illustrating a display conversion process using a 3D graphic function according to an embodiment of the present invention.

Referring to FIG. 7, in order to convert a 2D image 2D 'into a 3D image 3D' using a 3D graphic function, it is necessary to rotate the axis by using one vertical side of the 2D image 2D 'as an axis. do. 7 may be interpreted as obtaining a trapezoidal three-dimensional image 3D ′ on the right side by rotating the two-dimensional image 2D ′ using the left vertical side as the rotation axis. The origin is located at the center of the left vertical side (O ') of the 2D image (2D'), and the eye (Eye), the observation point, is located at a distance E apart from the origin (O ') to apply the 3D graphic function. , The distance between the eye and the projection plane is D, the rotation angle is theta (Theta), θ, the horizontal length of the two-dimensional image (2D ') A, the vertical length is B, two-dimensional image ( 2D '), the left and right edge coordinates of the axis of rotation, are (A, B / 2) and (A,-B / 2), respectively. As described above, when the left vertical side of the two-dimensional image 2D 'is rotated around the axis, a display-converted three-dimensional image 3D' can be obtained. The following relation holds between the two-dimensional image (2D ') and the three-dimensional image (3D'). Assuming that the abscissa value of the two-dimensional image 2D 'is Q and the ordinate value is R, the abscissa S and the ordinate T of the corresponding three-dimensional image 3D' are expressed by the following equations (3) and Can be expressed.

6 and 7 may be represented using variables of the 2D graphic function and the variables of the 3D graphic function, as shown in Equation 5 below.

8 to 10 are views showing a read mode image displayed through the user terminal 110 according to an embodiment of the present invention.

8 to 10, the left and right side images of the left and right side images of the e-book are changed according to the page position of the e-book currently being read. The way to implement this is as follows. First, the controller 520 forms the left side image of the e-book, and the trapezoidal direction is formed in the opposite direction to the trapezoid of the 3D images 3D and 3D ′ of FIGS. 6 and 7. That is, in contrast to FIGS. 6 and 7, the length of the left vertical side is shorter than the length of the right vertical side. The width W ′ of the left side image may be expressed as in Equation 6 below.

Here, W represents the overall thickness of the e-book.

Thereafter, the controller 520 forms the right side image of the e-book, and the trapezoidal direction is formed in the same shape as the trapezoid of the 3D images 3D and 3D ′ of FIGS. 6 and 7. That is, as shown in FIGS. 6 and 7, the length of the right vertical side is shorter than the length of the left vertical side. The width W '' of the right side image can be expressed by the following Equation (7).

Here, W represents the overall thickness of the e-book.

The controller 520 may synthesize the left side image formed by the above method on the left side of the left e-book image and synthesize the right side image on the right side of the right e-book image to form a read mode image.

Through this process, it is possible to implement (display) an e-book in the form of a three-dimensional codex in which a paper book, a distribution ratio of horizontal-vertical-thickness, a page layout, and the like are matched (even matching fonts).

Now, the process of processing the same user annotation function as the paper book in the e-book having the three-dimensional intuition displayed on the screen of the user terminal 110 will be described in detail. In an embodiment of the present invention, a user annotation function shows a bookmark, a memo, a highlighter, a line break, a free doodle, and the like.

11 is a diagram illustrating a configuration of a user annotation processing apparatus 500 according to an embodiment of the present invention. The user annotation processing apparatus may be provided in the controller 520 of the user terminal 110 or may be implemented as a separate module.

The user annotation processing apparatus 500 includes a bookmark processing unit 51, a memo processing unit 52, a highlight pen processing unit 53, a scribing processing unit 54, and a free doodle processing unit 55. The bookmark processor 51 includes a vertical width determiner 511, a horizontal width determiner 512, a side vertical position determiner 513, and a side horizontal position determiner 514. Each of the annotation processing units 51 to 55 of the user annotation processing apparatus 500 may be independently performed, or may be performed by some or all combinations thereof. The display unit 540 displays user annotations based on the processing results of the annotation processing units 51 to 55.

The bookmark processor 51 determines the size of the bookmark to be inserted into the e-book based on the size of the letter on the screen, and determines the position of the bookmark in the side portion of the e-book. The font size on the screen is the size (height) of the character selected by the user in terms of pixels, and is the size of the font actually displayed on the screen. Here, the size of the bookmark includes the vertical width and the horizontal width of the bookmark, the position of the bookmark includes the horizontal position and the vertical position of the bookmark in the side portion of the book. The bookmark whose size and position are determined by the bookmark processing unit 51 is inserted into the e-book and output through the display unit 540. FIG. 12 illustrates a bookmark in which a size and a position of a bookmark determined based on a size of a letter selected by a user is inserted into an e-book in a 3D codex format.

Since e-books in the 3D codex format have almost the same appearance as actual paper books, there are important technical problems to solve, such as 'determining the vertical width of the bookmark', 'determining the horizontal width of the bookmark', And the vertical position of the bookmark on the side of the book, and the horizontal position of the bookmark on the side of the book. The basic reason for bookmarking an e-book is to go directly to the bookmarked page through the bookmark. To do this properly, a technique for determining which bookmark corresponds to the location selected by the user is required. . This is because multiple bookmarks may overlap at the location you select.

Fixing the 'vertical width of the bookmark' is not a good idea when considering the ease of use of an e-book. Because the size of the screen on which the e-book is implemented is different, the vertical length of the bookmark, which is appropriately used on a monitor of resolution A and size A, has a resolution of B and a size of B. There is no guarantee that the monitor will be suitable. Here, the appropriate size means that the user can easily identify that the user has a bookmark in view, and it is difficult to select the bookmark with various pointing devices such as stylus, finger, mouse, etc. in order to go directly to the page where the bookmark is inserted. It means 'easy size'. In order to solve this problem, in the present invention, among the letters having various sizes (for example, among the letters having a size of 5 to 100 fonts), the user can be easily identified with the smallest Be sure to select the letters. If the user knows the font size of the character selected by the user, the size (height) of the character selected by the user can be converted in units of pixels. Specifically, it is as follows.

The user may arbitrarily set the size of the characters displayed on the screen of the display unit 540 by selecting the font size setting mode through the input unit 530. When the font size setting mode is set through the input unit 530, the controller 520 controls the display unit 540 to display the font setting interface on the screen. The user may input information on the minimum size of the text that can be read by the user through the text setting interface.

On the other hand, since the size of the characters actually displayed may be different depending on the screen resolution of the display unit 540, it is necessary to calculate the size of the characters actually displayed. When the minimum readable size selected by the user is displayed on the screen, the size of the text on the actual screen may be calculated as follows. That is, the user selects the size of the character that can be arbitrarily set, for example, the size of the minimum character that can be read as X (point), and the screen resolution of the display unit 540 is Y (ppi (pixel per inch) ), And the magnification of the character set in the operating system is Z (pixels / point, 1 for Mac OS X and 4/3 for MS-Windows). The actual size of S _R can be calculated as shown in Equation 8.

Here, the symbol {} denotes an operation symbol rounded off to one decimal place.

13 and 14 are diagrams illustrating examples of setting a text size by a user, and show an example of a screen for setting a minimum text size that a user can read in the user terminal 110 equipped with a touch screen. As illustrated in FIGS. 13 and 14, the size of a text may be set by drag input using a finger, a stylus, etc. on predetermined portions 131 and 141 on the touch screen of the user terminal 110. The size of the letter may be adjusted according to the drag length, and example sentences 132 and 142 showing letters of the size corresponding to the drag length may also be displayed together on the screen.

In the above-described embodiment, the configuration of setting the size of the text to the length of the drag input on the touch screen has been described, but the text size is not limited thereto. In another embodiment, the user may directly set the font size by using a keyboard or provide a font size on the screen of the display unit 540 as a pull-down or pull-up menu, and select the same by using a mouse pointer. The size can be configured to be selected using a radio button or the like.

For example, when the user selects the minimum readable font size set by the user through the input unit 530, the controller 520 reads the e-book file from the storage unit 510 and enlarges the e-book file at a predetermined magnification. Then, the magnification ratio for displaying the e-book file on the screen of the display unit 540 is selected by comparing the text size in the e-book file of each magnification and the set readable text size. In one embodiment, the magnification may have the following eight magnifications.

The first magnification is an enlargement ratio that displays both the main body of both pages of the e-book and the side portions of the book. The second magnification is an enlargement magnification displaying only two pages of both sides of the book without the side portion of the e-book, and the third magnification is an enlargement magnification of displaying both pages of the ebook but no margin of text is displayed. . In addition, the fourth magnification is an enlargement magnification in which one page and side portions of the e-book are displayed, and the fifth magnification is magnification magnification in which only one page of the e-book is displayed but no side portions are displayed, and the sixth magnification is magnification. Is an enlargement factor that displays only one page of an e-book, but does not display the blank space without letters. In addition, the seventh enlargement magnification is an enlargement magnification in which the entire page is not displayed but is grouped by an appropriate number and displayed in group units, and the eighth magnification is divided into one group so that only a part of the group is displayed on the screen. It is an enlargement magnification.

The controller 520 enlarges the e-book file read from the storage 510 at the first to eighth magnifications. In addition, the controller 520 compares the text size in the e-book adjusted to each enlargement magnification with the minimum readable text size selected by the user, and displays the text in the enlarged e-book equal to or larger than the minimum readable text size. The enlargement magnifications are selected, and an enlargement magnification that the entire outline of the e-book can display the most among the selected magnification magnifications. Meanwhile, as described above, the physical size of the characters displayed on the screen of the display unit 140 may be displayed differently depending on the screen resolution of the display unit 540. Therefore, in order to determine which of the above eight magnifications, the e-books according to the magnification ratio are equal to or larger than the minimum readable text size, the actual physical size of the characters displayed on the screen is considered for each magnification. In one embodiment, the controller 520 calculates the first physical size when the corresponding character is displayed on the screen of the display unit 540 based on the font size set by the input of the input unit 530, and expands the predetermined size. The second physical size is calculated when the letters of the electronic book of the magnification are displayed on the screen of the display unit 540, and the electronic book is displayed on the display unit 540 by comparing the first physical size and the second physical size. Select the magnification.

Meanwhile, the screen size (in pixels) of the 'minimum size text selected by the user' obtained through the above method is linked with the 'vertical width of the bookmark'.

The vertical width determining unit 511 may determine the vertical width of the bookmark through Equation 9 below.

Where C is any constant for determining the vertical width of the bookmark.

The horizontal width determiner 512 may determine the horizontal width of the bookmark through Equation 10 below.

Where D is any constant for determining the width of the bookmark in the horizontal direction.

The side vertical positioning unit 513 determines the vertical position of the bookmark in the side portion of the book. For example, the 'vertical position of the bookmark at the side of the book' can be arbitrarily determined. In an embodiment, when a new bookmark is to be inserted, the vertical position of the bookmark may be determined by Equation 11 below.

The reason for randomly determining the vertical position of the bookmark in the side of the book is that, in general, the probability distribution of random numbers that can be generated on the computer shows a flat probability distribution with the same occurrence frequency probability value for each band. Because. This is because the method of the present invention can minimize the probability that the vertical heights of the bookmarks coincide even when inserting a large number of bookmarks over several pages. If the vertical heights of specific bookmarks coincide with each other, when the user selects a specific one among the bookmarks inserted by the user, the same vertical position causes the area to overlap on the screen, thereby reducing the inconvenience of incorrectly selecting the bookmark. to be.

In addition, the user may arbitrarily change the 'vertical position of the bookmark in the book side portion' determined by the side vertical position determiner 513 through the input unit 530.

The side horizontal positioning unit 514 determines the horizontal position of the bookmark in the side portion of the book. In one embodiment, if the page number into which the bookmark is inserted is E, the page number currently expanded on the screen is F, and if E <F and the e-book grows from left to right, the bookmark is opened. Located on the left side of the book 'the horizontal position of the bookmark in the left side of the book' can be determined by the following equation (12).

On the other hand, if the page number where the bookmark is inserted is E, the page number currently expanded on the screen is F, and if E> F and the e-book grows from left to right, the bookmark is located on the right side of the open book. The horizontal position of the bookmark in the right side of the book can be determined by the following equation (13).

However, when calculated in this manner, it may be well applied to the screen of the e-book as shown in FIG. 12, but it may be difficult to apply the error due to the error of the screen of the e-book as shown in FIG. 16. On the side of the book lying at an angle as shown in FIG. 15, an e-book is opened. The side portion of the book is mathematically transformed into a perspective transform. Therefore, if the side portion of the book has been transformed from the viewpoint, it should be corrected to reflect the horizontal position of the bookmark in the side portion of the book. That is, the viewpoint conversion process as shown in FIG. 6 is required, and the exact position can be obtained by using Equation 1 above.

Another problem that needs to be solved in relation to bookmarks is the question of which one should be selected if multiple bookmarks exist at the same location selected by the user using a pointing device. In one embodiment, for example, if the bookmarks selected by the user are located in the left part of the book, the bookmark with the largest number of pages among the selected bookmarks is selected, and if the bookmarks selected by the user are located in the right part of the book, among the selected bookmarks. You can select a bookmark with the smallest number of pages. This method is valid because, when the book is opened, as shown in the bookmark inserted in the side section of the obliquely lying book of FIG. 16, the bookmark with the large number of pages covers the top of the bookmark with the small number of pages. Similarly, when the book is opened, a bookmark with a small number of pages covers the top of the bookmark with a large number of pages on the right side of the book.

The memo processing unit 52 determines the size and position of the mark based on the form of the mark indicating that there is a memo inserted in the e-book and the distance of the object between the lines. In one embodiment, when the memo is inserted into the e-book as shown in FIG. 17, the display unit 540 indicates that there is a memo based on the mark type and the size and position of the mark determined by the memo processor 52. 18 is indicated by a rectangle of a suitable size in a position that does not disturb the reading on the e-book as shown in FIG. As illustrated in FIG. 17, a user may insert a desired text by inserting a desired text through a input unit 530 on a specific portion of an e-book using a memo function. However, if the content of the inserted memo always appears on the screen, it will obstruct the user's reading by hiding the letters or pictures in the text of the e-book. Therefore, in the present invention, rather than showing all the contents of the memo on the screen even when the user reads the e-book so that the inserted memo does not interfere with the user's reading, as shown in FIG. A marker (square shape) 18a shows that it exists, and shows, edits, or deletes all the notes in the memo only when the user selects the marker 18a with a pointing device. Apply. In FIG. 18, each of the three small rectangles 18a between the first line and the second line marks memos inserted. If the user selects the rectangles 18a, the screen switches to a screen where the contents of the corresponding memo input in FIG. 17 can be viewed, edited or removed.

In order to avoid disturbing the user's reading, it is important to determine the size and position of the marker (square) representing the inserted memo. Therefore, the memo processing unit 52 tracks the objects displayed on the screen of the e-book that the user is viewing at the moment of inserting the memo, and sequentially assigns the positions of these objects as the positions of the markers. In other words, there are objects (pictures and texts) in the screen area that guides the user to read on the screen that the user is viewing just before inserting the memo. As an example of the guide area, a portion of the e-book that a user reads is highlighted and shown, and the guide area may be a line unit, a group unit, a page unit, or the like.

In addition, objects have an order. If the user inserts the first memo in the guide area, the position of the marker indicating that the first memo is present is assigned to the position of the first object in the guide area. Similarly, when the user inserts a second memo in the guide area, the position of the marker indicating that this second memo is present is assigned to the position of the second object belonging to the guide area. This way, you can insert as many notes as the total number of objects shown on the entire screen, but that's not a problem because you don't actually insert so many notes.

The memo processing unit 52 determines the position of the mark indicating that there is a memo, and then determines the size of the mark. At this time, the basic constraint is that the objects in the body of the e-book should not be hidden due to the corresponding markers (squares). The memo processor 52 tracks a line in the area where the reference object that determines the position of the mark (ie, the same position as the mark) exists, searches all objects existing in the line and the next line, Measure the distance between objects and the reference object. And, the smallest value among the distances is set as the vertical height value A of the mark (square). For example, if the reference object is located on the 6th line, measure all the distances between all objects on the 7th line and the reference object, and then use the shortest distance among them as the height of the marker. . In one embodiment, a value slightly smaller than the vertical height value A is utilized to make the user more visible. The horizontal width of the marker (square) is obtained by multiplying the vertical height by a specific constant. If this constant value is 1, the shape of the marker (square) becomes square. If the value is less than 1, the vertical rectangle is long. If the value is greater than 1, the horizontal rectangle is long.

If the size of the mark is implemented in this manner, the mark (the rectangle) never covers the objects appearing in the body of the e-book, so that the user can read without being disturbed by the mark (the rectangle).

If the body portion of the e-book is displayed in perspective transform as shown in FIG. 12, the position of the marker (square) indicating that there is a memo should also be corrected. That is, the viewpoint conversion process as shown in FIG. 6 is required, and the exact position can be obtained by using Equation 1 above.

The highlighter processor 53 identifies the start and end points of the highlighter, collects location information due to the movement of the pointing device to implement the highlighter function, and displays the thickness of the highlighter, the physical width represented by one pixel, and the e-book file. The thickness of the pen used to paint the highlighter to be displayed on the e-book is determined based on the magnification to be displayed on the screen of 540. The display unit 540 displays the highlighter painted on a specific portion of the e-book on the e-book by the thickness of the highlighter determined by the highlighter processing unit 53. 21 is a diagram illustrating an example of implementing a highlighter function in an e-book according to an embodiment of the present invention.

The line processing unit 54 checks the start point and the end point of the line segment to be drawn on the body of the e-book, and displays the thickness of the pen to draw the line segment, the physical width represented by one pixel, and the e-book file on the screen of the display unit 540. The thickness of the pen drawing a line segment is determined based on the magnification to be done. The display unit 540 displays the underline drawn on a specific portion of the e-book on the e-book with the thickness of the scribe pen determined by the squeeze processing unit 54. 19 is a diagram illustrating an example of implementing a line break function in an e-book according to an embodiment of the present invention.

The free doodle processing unit 55 checks the start and end points of the free doodle, such as writing or drawing in the text of the e-book, collects location information due to the movement of the pointing device, and implements the free doodle. The thickness of the pen for free grading is determined based on the thickness of the pen, the physical width represented by one pixel, and the magnification to display the e-book file on the screen of the display unit 540. In addition, the display unit 540 displays the user annotation of a text or a picture processed on a specific portion of the e-book on the e-book by the thickness of the free scribble pen determined by the free scribble processor 55. 20 is a diagram illustrating an example of implementing a free doodle function in an e-book according to an embodiment of the present invention.

The scribing function draws a line segment in the body of an e-book. To create a line segment, you need to know the start and end points of the line segment. This is done by using the input start position of the pointing device as the start point and the input end position. However, in addition to the start point and the end point, the free graffiti and the highlighter must collect all the position information input, that is, sampled at regular intervals each time the pointing device moves. In addition, treating the sequence of the collected location information as the control points of the splines, respectively, can implement a free doodle and highlighter function.

By the way, it is important to determine the thickness of the pen to be used when drawing lines, graffiti freely, or highlighter. If we actually draw a line with a 0.5mm pen, the problem is how big the pen should be on the page of the e-book. If we assume that the picture of each page of the e-book is created in Pixel Per Inch (S ppi) and implemented on the screen at 100% magnification, the physical width represented by one pixel is 1 / S (inch), Converting it to mm results in "25.4 / S (mm)". Therefore, assuming that the thickness of the pen desired by the user is T (mm), in this case, the screen appears as (T * S) /25.4 pixels. If the screen magnification is U, the pen is finally expressed on the screen with a thickness of [(S * T * U) /25.4] pixels. Here, the symbol [] means round to one decimal place.

By using the present invention described above, it is possible to implement all kinds of user annotations possible in a paper book even in an e-book. Also, user annotations can be realistically implemented in 3D codex format e-books.

However, one of the advantages that e-books have over paper books is that the same book can be viewed on many devices. For example, you can use your specific e-books on MS-Windows-based PCs, Mac OS X-based computers, iOS-based phones or tablets, and Android-based phones or tablets. In this case, it will be very convenient if the annotation inserted by the user in one device of the user (for example, the user terminal 1) is shared and applied in common to other devices of the user (for example, the user terminals 2 and 3). In the present invention, it is implemented through the annotation synchronization server 140.

22 is a flowchart illustrating a procedure for synchronizing user annotations according to an embodiment of the present invention. For better understanding, the following description will be made with reference to FIGS. 4 and 5.

There are two important issues with annotation synchronization. One is that when you make changes to user annotations on different devices at the same time for the same e-book, they are reflected on all devices. On the other hand, if one device has failed to access the annotation synchronization server 140, and if the user annotation of the e-book is changed and the subsequent connection of the annotation synchronization server 140 is successful, the user annotation changed in the corresponding e-book is written. How to handle it.

In the present invention, a unique number (ebook unique number) is assigned to all the e-books so that the annotation synchronization server 140 can synchronize the annotations of the e-books. A unique number for each e-book is used to distinguish each e-book from the annotation synchronization server 140.

The information stored and managed by the annotation synchronization server 140 in the DBMS 120 includes e-book unique numbers in the personalization area, user annotation information, time information in which annotation information is recorded in the annotation synchronization server 120, And the unique number of the user terminal 110 to which the annotation information processed in the e-book is sent. The user annotation information includes annotation data (e.g. bookmark data, memo data, highlighter data, scribble data, free doodle data, etc.) and annotation name information (e.g. bookmarks a, b, ..., n, memo a, b, ..., n, highlighters a, b, ..., n, lines a, b, ..., n, free doodles a, b, ..., n, etc.). The user can arbitrarily designate a comment name for easy retrieval when annotating the e-book, and it is preferable to configure each comment name so that it is not duplicated. Annotation names are not limited to the forms of letters (Korean or English), numbers, special characters, etc., as long as they can be identified. For example, the comment name may be composed of letters, numbers, or special characters, or a combination of some or all of them.

The user terminal 110 may not be able to access the annotation synchronization server 140 due to a network failure, and thus may not receive annotation information stored in the DBMS 120. When the user terminal 110 executes any e-book, if the annotation information of the e-book is not obtained from the DBMS 120, then the contents of the user annotation written in the e-book by the user and the annotation stored in the DBMS 120 Problems arise in which information can vary. In this case, it is difficult to determine what annotation information the user really wants among the annotation information 1 present in the user terminal 110 and the annotation information 2 present in the DBMS 120. The answer is that each user can be different. That is, some users will prioritize annotation information 1 stored in DBMS 120, although past annotation information [A], and other users will give priority to annotation information 2 currently stored in user terminal 110. [B], another user may wish to integrate both pieces of information (comment information 1 and 2) [C].

To this end, the present invention can give the user the following options. One is a 'manual mode' for querying which method to select A, B, or C when the user accesses the annotation synchronization server 140, and the other is an automatic mode in which annotation information 1 and annotation information 2 are unconditionally integrated. . That is, the A method is to maintain the annotation information 1 of the DBMS 120, the B method is to reflect (update or newly store) the annotation information 2 to the DBMS 120, and the C method is to integrate the annotation information 1, 2 It is. In the manual mode, when the user closes the e-book, it is checked whether the annotation information 2 is reflected (updated or newly stored) in the DBMS 120, and in the automatic mode, the annotation information 2 is unconditionally reflected in the annotation information 1.

In addition, in the present invention, when an annotation is corrected in different devices for the same e-book at the same time, it is solved in the following manner.

The user terminal 110 attempts to connect to the annotation synchronization server 140 when the e-book application is executed (S201). If the connection to the annotation synchronization server 140 fails (S202), the annotation list from the DBMS 120 is displayed. The electronic book file is executed in a state in which the single or multiple annotation information of the single or multiple e-books is not transmitted and the annotation synchronization server 140 is not connected (this is referred to as a 'local state' for convenience) (S203). The user can freely process the annotation on the e-book in the local state (S204). If the user terminates the e-book application (S205), the process proceeds to step S210. The annotation information processed in the local state is called local annotation information.

In step S210, if the user wants to store the local annotation information processed in the local state in the DBMS 120, check whether the annotation synchronization server 140 is connected, and if not connected to only the user terminal 110 local If the annotation information is stored and connected, the annotation information is stored in the DBMS 120 as well as the user terminal 110 (S211). In this case, in the 'manual mode', the annotation synchronization server 140 confirms to the user whether to store the local annotation information in the DBMS 120 and reflects the confirmation matter. However, in the 'auto mode', the annotation synchronization server 140 reflects the local annotation information processed by the user terminal 110 to the DBMS 120 without undergoing confirmation to the user.

In the above step S202, if the connection to the annotation synchronization server 140 is successful (S202), the annotation synchronization server 140 in the 'manual mode' whether or not to import the user annotation information existing in the DBMS 120 to the user Check and reflect the check as it is. In addition, in the 'auto mode', the annotation synchronization server 140 controls the search server 130 without checking the user, and the annotation list (single or single of a single or multiple e-books) in the DBMS 120 is controlled. A plurality of annotation information) is transmitted to the user terminal 110, so that the annotation information can be synchronized in the user terminal 110 (S206). At this time, the annotation synchronization server 140 maps the time A at which the annotation information is transmitted to the user terminal 110 to the corresponding annotation information and records the same in the DBMS 120.

Thereafter, the user can freely process the annotation on the e-book (S207). If the user terminates the e-book application (S209), the process proceeds to step S210.

In step S210, in the "manual mode" annotation synchronization server 140 confirms to the user whether to store the local annotation information in the DBMS 120, and reflects the confirmation. However, in the 'auto mode', the annotation synchronization server 140 reflects the local annotation information processed by the user terminal 110 to the DBMS 120 without going through a process of confirming to the user (S212).

Looking at the process that the annotation synchronization server 140 reflects local annotation information in the DBMS 120, first confirms the annotation storage location of the e-book. Then, the annotation information and the final storage time (B) of the e-book are checked. As a result of the check, if A and B are not the same, local annotation information processed by the user terminal 110 is reflected in the annotation information of the DBMS 120.

Since the annotation information (including the comment list) transmitted between the user terminal 110 and the annotation synchronization server 140 is encrypted and transmitted, the counterpart device performs a decoding process before execution.

23 is a flowchart illustrating a procedure for retrieving user annotations according to an embodiment of the present invention.

In one embodiment, the annotation list may consist of information about user annotations for which the user may utilize text search. In one embodiment, bookmarks, notes, and the like among user annotations are useful for utilizing text search. Since this annotation list is provided when the user terminal 110 accesses the annotation synchronization server 140, the user can search not only the e-book through the currently open text search, but also all the e-books stored in his terminal 110. The user annotation may be searched, and the user annotation may be integrated and searched even for an e-book not stored in the own terminal 110.

When the user terminal 110 attempts to connect to the annotation synchronization server 140 by executing an e-book application (S301), the annotation synchronization server 140 controls the search server 130 to display the annotation list in the DBMS 120. The bibliographic information is transmitted to the user terminal 110 together with the single or plural annotation information of the single or multiple e-books (S303). At this time, the annotation list is encrypted and transmitted.

Here, the user terminal 110 accessing the annotation synchronization server 140 requests all annotation information in which user annotations are processed among electronic books in the personalization area (S302).

Thereafter, the user terminal 110 decrypts the received annotation list (eg, bookmark information related to the memo) and then searches for a character input by the user (S304). At this time, character input for searching is performed through the input unit 530. [ Then, the control unit 520 of the user terminal 110 finds user annotations (bookmarks and memos) that match the characters entered by the user, and lists their contents and basic bibliographic information of the e-books corresponding to them. The output is collectively output to the display unit 540 (S305). At this time, if the user wants to read a specific ebook among each ebook list displayed on the screen, if the ebook file selected by the user exists in the user terminal 110 currently being used, the corresponding ebook is executed and the corresponding user annotation is executed. Navigate to where you are (for example, a note or bookmark). On the other hand, if the e-book file selected by the user does not exist in the user terminal 110 currently in use, the user terminal 110 downloads the e-book file from the DBMS 120 and executes the corresponding user annotation (for example, Go to the location of the note or bookmark).

Although the method has been described through specific embodiments, the method may also be embodied as computer readable code on a computer readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may be implemented in the form of a carrier wave (for example, transmission over the Internet) . In addition, the computer-readable recording medium may be distributed over network-connected computer systems so that computer readable codes can be stored and executed in a distributed manner. In addition, functional programs, codes, and code segments for implementing the above embodiments can be easily deduced by programmers of the present invention.

Although the present invention has been described in connection with some embodiments thereof, it should be understood that various changes and modifications may be made therein without departing from the spirit and scope of the invention as understood by those skilled in the art. something to do. It is also contemplated that such variations and modifications are within the scope of the claims appended hereto.

110: user terminal 120: DBMS
130: Search Server 140: Annotation Synchronization Server
510: storage unit 520: control unit
530: input unit 540: display unit

Claims (20)

As a user annotation processing device of an e-book,
A bookmark processing unit which determines the size of the bookmark to be inserted into the e-book based on the size of the text on the screen, and determines the position of the bookmark in the side portion of the e-book;
And a display unit for displaying a bookmark on the e-book based on a processing result of the bookmark processing unit. The method of claim 1,
The size of the text on the screen is a size of the text selected by the user in pixel units, which is the size of the text actually displayed on the screen, the user annotation processing apparatus. The method of claim 1,
The size of the bookmark includes a vertical width and a horizontal width of the bookmark,
And the bookmark position includes a horizontal position and a vertical position of the bookmark in a book side portion. The method of claim 3,
The letter size S _R on the screen is calculated based on the following equation (1): the size (X), the screen resolution (Y), and the enlargement magnification (Z) of the letter set by the user.
And a vertical width and a horizontal width of the bookmark are calculated based on the size of the text on the screen.
(Equation 1)

(Where the symbol {} is an operation symbol rounded to one decimal place) The method of claim 3,
The vertical position of the bookmark in the side portion of the book is calculated using a random probability distribution, but calculated based on Equation 1 below, the user annotation processing apparatus.
(Equation 1)
The vertical position of the bookmark on the book, the side portions = {(the current was generated random numbers) / (the maximum value of the random number - minimum value of the random number)} * (vertical height of the electronic book) The method of claim 3,
Among the horizontal position of the bookmark in the side portion of the book,
If the page number where the bookmark is inserted is E, the page number currently expanded on the screen is F, and if E <F and the e-book grows from left to right, the horizontal position of the bookmark in the left side of the book A user annotation processing device, calculated on the basis of Equation 1.
(Equation 1)
Horizontal position of the bookmark in the left side of the book = (E / F) * (original width of the side of the corresponding ebook) * (F / total number of pages in that ebook) The method of claim 3,
Among the horizontal position of the bookmark in the side portion of the book,
If the page number where the bookmark is inserted is E, the page number currently expanded on the screen is F, and if E> F and the e-book grows from left to right, the horizontal position of the bookmark in the right side of the book A user annotation processing device, calculated on the basis of Equation 1.
(Equation 1)
Horizontal position of the bookmark in the right side of the book = {(EF) / (Total number of pages in the ebook-F)} * (Original width of the side of the ebook) * {1-(F / Total of the ebook Pages)} As a user annotation processing device of an e-book,
A memo processing unit for determining the size and position of the mark based on the shape of the mark indicating that there is a memo inserted in the e-book, and the distance of the object between lines;
And a display unit configured to display the mark on the e-book based on a processing result of the memo processor. 9. The method of claim 8,
The location of the marker tracks the objects displayed on the screen when inserting the note, and sequentially assigns the location of the corresponding objects,
Wherein an interval between the object existing on the next line of the line on which the reference object which has determined the position of the marker exists and the reference object is used as the height of the marker. As a user annotation processing device of an e-book,
An annotation processing unit for determining the thickness of the pen to be displayed in the e-book based on the thickness of the at least one pen of the highlighter, the line-up pen, the free graffiti pen, the width of the pixel, the screen magnification;
And a display unit configured to display, on the e-book, at least one user annotation of a highlighter, underline, and free graffiti processed on a predetermined portion of the e-book by the thickness of the pen determined by the annotation processing unit. 11. The method according to any one of claims 1 to 10,
The e-book is a 3D codex format e-book which converts a rectangular 2-dimensional side image into a trapezoid-shaped 3-dimensional side image using a 2-dimensional graphics function. The method of claim 11,
When the coordinates of the two-dimensional side image is represented as (Y, V), the coordinates of the three-dimensional side image corresponding to (X, U), (X, U)
And a two-dimensional graphic function defined by Equations 2 and 3 below.
(2)

(3)

(W represents the length in the horizontal direction in the two-dimensional side image, L1 represents the length in the vertical direction in the two-dimensional side image and the length of the base in the three-dimensional side image, L2 is a three-dimensional side image (3D) Means the length of the upper side in The method of claim 12,
And correcting the horizontal position of the bookmark and the position of the mark in the book side portion by the equation (2). As an e-book service system,
A database management system (DBMS) that stores the unique number of the entire e-book and maps and manages the annotation information processed in the e-book for each user and the storage time information in which the annotation information is stored to the e-book unique number in the personalization area; ,
A search server that searches for and provides corresponding annotation information mapped to the e-book unique number of the personalization area from the DBMS in response to the annotation search request;
And an annotation synchronization server for distinguishing e-books based on the unique numbers and synchronizing the annotation information based on the storage time information. 15. The method of claim 14,
The e-book is an e-book service system of a three-dimensional codex (codex) format that is converted into a three-dimensional side image of the trapezoidal shape by using a two-dimensional graphics function of a rectangular two-dimensional side image. 15. The method of claim 14,
The annotation search request is an e-book service system, which is a name of an annotation input by a user at the time of annotation processing, or a request for all annotation information processed by a user annotation among electronic books in a personalization area. 15. The method of claim 14,
The DBMS stores an e-book in a personalization area for each user, and stores and manages, for each user, annotation information processed in an e-book in a three-dimensional codec format on a user terminal. 15. The method of claim 14,
The search server searches for e-books in the personalized and non-personalized areas, and searches for users by integrating user annotations processed in the e-books in the personalized areas purchased or loaned by each user. As an e-book service method,
The unique number of the entire e-book is stored in the DBMS, and the annotation information processed in the e-book for each user and the storage time information in which the annotation information is stored are mapped to the unique number of the e-book in the personalization area. Steps,
Responsive to an annotation search request, retrieving and providing corresponding annotation information mapped to the e-book unique number of the personalization area from the DBMS;
Distinguishing the e-book based on the unique number, and synchronizing the annotation information based on the storage time information. 20. The method of claim 19,
The e-book is an e-book in a three-dimensional codex format that converts a rectangular two-dimensional side image into a trapezoidal three-dimensional side image using a two-dimensional graphics function.

Images