CN114020800A - A data processing method and device for big data - Google Patents
A data processing method and device for big data Download PDFInfo
- Publication number
- CN114020800A CN114020800A CN202111295428.XA CN202111295428A CN114020800A CN 114020800 A CN114020800 A CN 114020800A CN 202111295428 A CN202111295428 A CN 202111295428A CN 114020800 A CN114020800 A CN 114020800A
- Authority
- CN
- China
- Prior art keywords
- data
- user
- data information
- information
- range
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 27
- 238000012216 screening Methods 0.000 claims abstract description 16
- 238000007781 pre-processing Methods 0.000 claims description 28
- 230000009191 jumping Effects 0.000 claims description 8
- 238000000034 method Methods 0.000 claims description 4
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computational Linguistics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the technical field of big data, and discloses a big data-oriented data processing method and device, which comprise the following steps: the first step is as follows: a data search request; the second step is that: storing historical information; the third step: searching data information; the fourth step: intercepting a keyword; the fifth step: marking a historical search record; and a sixth step: screening a data information range; the seventh step: recording range information; eighth step: the screening range is narrowed. In the invention, if the results are not matched, the data information initially submitted by the user is read, the data information originally submitted by the user is deleted, the read data information initially submitted by the user is searched in the historical query set, and the data information initially submitted by the user in the historical query set is specially marked, so that the user can know that the data recorded in the historical search is not queried by checking the data information in the historical query set, and the situation that the data is repeatedly searched is avoided.
Description
Technical Field
The invention relates to the technical field of big data, in particular to a big data-oriented data processing method and device.
Background
Big data, or huge data, refers to the data that is too massive to be captured, managed, processed, and organized into information that helps enterprise business decision making more positive in a reasonable time through the current mainstream software tools.
The existing big data in the market at present utilizes a data set which captures, manages and processes the content of the big data by using an unconventional software tool within a certain time, so that a plurality of redundant information records are generated for the information of a certain piece of data in the big data, and redundant information records are excessive, so that a worker extracts the repeated data.
Therefore, a data processing method and device facing big data are provided.
Disclosure of Invention
The present invention mainly solves the technical problems existing in the prior art, and provides a data processing method and device for big data.
In order to achieve the above object, the present invention adopts the following technical solution, a big data oriented data processing method, comprising the steps of:
the first step is as follows: a data search request;
the second step is that: storing historical information;
the third step: searching data information;
the fourth step: intercepting a keyword;
the fifth step: marking a historical search record;
and a sixth step: screening a data information range;
the seventh step: recording range information;
eighth step: the screening range is narrowed.
Preferably, the first step is to submit data information to be searched by a user;
and the second step is to store the data information which is submitted by the user and needs to be searched in a historical record set.
Preferably, the query request condition in the third step is matched with an object or an attribute in the database, if the result is matched, the sixth step is skipped, a data preprocessing result set containing the related object or attribute in the database is called, and the data preprocessing result set containing the related object or attribute in the database is directly output outwards.
Preferably, the fourth step divides the data information to be searched submitted by the user into a plurality of individual data information in sequence, or the user merges each individual data according to the original data information to be searched, divides the original required retrieval data information into a plurality of sections, retrieves the individual data information or one section of data information in sequence, and if matched data information exists, jumps to the sixth step, directly outputs a data preprocessing result set containing related objects or attributes in the database, and simultaneously marks the data information which is not retrieved and stores the data information in the historical query set.
Preferably, the fifth step returns to the first step, reads the data information initially submitted by the user, deletes the data information originally submitted by the user, searches the read data information initially submitted by the user in the historical query set, and specially marks the data information initially submitted by the user in the historical query set.
Preferably, the sixth step searches for the maximum value and the minimum value in the data output outwards, displays the maximum value and the minimum value in the data output outwards, and the user can submit the output range; if the range is exceeded, outputting prompt information to enable the user to reselect the range, or enabling the user to submit specific information, and skipping the following steps to directly output the retrieved data; and let the user re-enter the range.
Preferably, the seventh step stores the range records submitted by the user in a range collection;
and the eighth step of searching the maximum value and the minimum value of the output data, re-operating the sixth step, and storing the range causing the output of the prompt information into a range convergence when the prompt information is output.
The utility model provides a towards data processing device of big data, includes the frame, the frame is the cavity rectangular block shape, and the inside bottom wall fixed mounting of frame has the control mainboard, and the outside top wall fixed mounting of frame has the input device who is in the same place with control mainboard electric connection, and the outside top wall fixed mounting of frame has the controlling means who corresponds each other with input device, and controlling means and control mainboard electric connection are in the same place.
Preferably, a display device electrically connected with the control main board is fixedly mounted in the middle of the outer top wall surface of the outer frame, the top wall surface of the control main board is electrically connected with a computing device, the top wall surface of the outer frame is electrically connected with a storage device, and a database is arranged in the storage device.
Advantageous effects
The invention provides a data processing method and device for big data. The method has the following beneficial effects:
(1) the user submits data information needing to be searched through the input device and the control device, the user checks the information input by the user through the display device, the data information in the display device is read through the arithmetic device, the retrieval and the matching are carried out in the storage device, if the results are matched, a data preprocessing result set containing related objects or attributes in a database in the storage device is called, the data preprocessing result set containing the related objects or attributes in the database is directly output outwards, if the results are not matched, the data information initially submitted by the user is read, the data information originally submitted by the user is deleted, the read data information initially submitted by the user is searched in the historical query set, and the data information initially submitted by the user in the historical query set is specially marked, the user can know that the data recorded in the historical search is not searched by checking the data information in the historical query set, so that the situation that the data is repeatedly searched is avoided.
(2) Dividing the data information submitted by the user and needing to be searched into a plurality of pieces of data information, or combining the data information into a plurality of pieces of data information in sequence by the user, combining the data information into a plurality of pieces of data information in sequence according to the data information formed in sequence or combining the data information formed in sequence by the user into a plurality of pieces of data information in sequence, matching the data information in the database, directly outputting a data preprocessing result set containing related objects or attributes in the database, marking the data information which is not searched, storing the data information in a history query set, dividing the data information submitted by the user and needing to be searched into a plurality of pieces of data information formed in sequence, or combining the data information formed in sequence into a plurality of pieces of data information by the user, the data retrieval range is widened, the situation that the data cannot be found due to the fact that a user records the data which are not retrieved is avoided, the user can check the data which are not retrieved, and the user can conveniently find the data.
(3) The maximum value and the minimum value in the data output outwards are displayed by searching the maximum value and the minimum value in the data output outwards, a user can submit the output range, if the output range is not beyond the range, the output data are directly screened according to the range submitted by the user, if the output data exceed the range, prompt information is output, the user can reselect the range, or the user submits specific information, screening is skipped, the retrieved data are directly output, the range of the output data information is limited by the user, and the situation that the data searching speed of the user is slow due to the fact that the data with the same attribute are too much is avoided.
(4) According to the big data-oriented data processing method and device, the maximum value and the minimum value in the data output outwards are displayed by searching the maximum value and the minimum value in the data output outwards, the user can submit the output range, the range submitted by the user is stored in the range set, and when the user does not have the data searched in the last range, the record is stored through the range set, so that the situation that the user forgets is avoided.
(5) According to the big data-oriented data processing method and device, the maximum value and the minimum value of the output data are searched, the sixth step is operated again, when the prompt information is output, the range which leads to the output of the prompt information is stored in the range collection, the user is prompted, the situation that the user submits the information which exceeds the range for many times due to the change of the data is avoided, the range of the data is limited for many times by operating the sixth step for many times, the range of the data output is smaller and smaller, and the searching of the user is facilitated.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below. It should be apparent that the drawings in the following description are merely exemplary, and that other embodiments can be derived from the drawings provided by those of ordinary skill in the art without inventive effort.
The structures, ratios, sizes, and the like shown in the present specification are only used for matching with the contents disclosed in the specification, so as to be understood and read by those skilled in the art, and are not used to limit the conditions that the present invention can be implemented, so that the present invention has no technical significance, and any structural modifications, changes in the ratio relationship, or adjustments of the sizes, without affecting the effects and the achievable by the present invention, should still fall within the range that the technical contents disclosed in the present invention can cover.
FIG. 1 is a flowchart of an embodiment of a big data oriented data processing method of the present invention;
FIG. 2 is a flowchart illustrating a big data oriented data processing method according to an embodiment of the present invention;
FIG. 3 is a flowchart of an embodiment of a big data oriented data processing method according to the present invention;
FIG. 4 is a flowchart illustrating a big data oriented data processing method according to an embodiment of the present invention;
FIG. 5 is a flow chart of a fifth embodiment of a big data oriented data processing method according to the present invention;
FIG. 6 is a schematic structural diagram of a big data oriented data processing apparatus according to the present invention.
Illustration of the drawings:
1. an outer frame; 2. a control main board; 3. an input device; 4. a control device; 5. a display device; 6. an arithmetic device; 7. and a storage device.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The first embodiment is as follows: a big data oriented data processing method, as shown in fig. 1, includes the following steps:
the first step is as follows: a data search request, wherein data information to be searched is submitted by a user;
the second step is that: history information storage, and storing data information which is submitted by a user and needs to be searched in a history record set;
the third step: searching data information, matching the query request condition with an object or an attribute in the database, if the result is matched, skipping the fourth step, calling a data preprocessing result set containing the related object or attribute in the database, and directly outputting the data preprocessing result set containing the related object or attribute in the database;
the fourth step: and marking the history search records, returning to the first step, reading the data information initially submitted by the user, deleting the data information originally submitted by the user, searching the read data information initially submitted by the user in the history query set, and specially marking the data information initially submitted by the user in the history query set, so that the user can know that the data recorded in the history search is not queried by checking the data information in the history query set, and the occurrence of repeated searching is avoided.
A data processing device facing big data is disclosed, as shown in FIG. 6, comprising an outer frame 1, wherein the outer frame 1 is in a hollow rectangular block shape, a control mainboard 2 is fixedly installed on the inner bottom wall of the outer frame 1, an input device 3 electrically connected with the control mainboard 2 is fixedly installed on the outer top wall of the outer frame 1, a control device 4 corresponding to the input device 3 is fixedly installed on the outer top wall of the outer frame 1, the control device 4 is electrically connected with the control mainboard 2, a display device 5 also electrically connected with the control mainboard 2 is fixedly installed at the middle position of the outer top wall of the outer frame 1, the display device 5 and the control mainboard 2 are electrically connected together, the input device 3 and the control device 4 are also electrically connected with the control mainboard 2, so that the content displayed inside the display device 5 can be controlled through the input device 3 and the control device 4, the top wall electric connection of control mainboard 2 has arithmetic device 6, and the top wall electric connection of frame 1 has storage device 7, and storage device 7 is inside to be provided with the database, through being in the same place arithmetic device 6 and storage device 7 and control mainboard 2 electric connection, and display device 5 is in the same place with control mainboard 2 electric connection, operates the data that will export through arithmetic device 6, makes control mainboard 2 can outwards export the inside content of storage device 7 through display device 5.
The working principle of the invention is as follows:
in the invention, a user submits data information needing to be searched through an input device 3 and a control device 4, the user checks the information input by the user through a display device 5, reads the data information in the display device 5 through an arithmetic device 6, searches and matches the data information in a storage device 7, if the data information is matched with the data information, calls a data preprocessing result set in a database in the storage device 7, wherein the data preprocessing result set comprises related objects or attributes, directly outputs the data preprocessing result set in the database, wherein the data preprocessing result set comprises the related objects or attributes, if the data information is not matched with the data information, the data information submitted by the user initially is read, the data information originally submitted by the user is deleted, the read data information submitted by the user initially is searched in a history query set, and the data information submitted by the user initially in the history query set is specially marked, the user can know that the data recorded in the historical search is not searched by checking the data information in the historical query set, so that the situation that the data is repeatedly searched is avoided.
Example two: a big data oriented data processing method, as shown in fig. 2, includes the following steps:
the first step is as follows: a data search request, wherein data information to be searched is submitted by a user;
the second step is that: history information storage, and storing data information which is submitted by a user and needs to be searched in a history record set;
the third step: searching data information, matching the query request condition with an object or an attribute in a database, if the result is matched, skipping the fourth step and the subsequent steps, calling a data preprocessing result set containing a related object or attribute in the database, and directly outputting the data preprocessing result set containing the related object or attribute in the database outwards;
the fourth step: intercepting keywords, namely dividing data information which needs to be searched and is submitted by a user into a plurality of pieces of independent data information in sequence, or combining each piece of independent data according to the original data information which needs to be searched by the user, dividing the original required retrieval data information into a plurality of sections, retrieving the independent data information or one section of data information in sequence, skipping the fifth step if matched data information exists, directly outputting a data preprocessing result set containing related objects or attributes in a database outwards, marking data information which is not retrieved, and storing the data information which is not retrieved in a historical query set;
the fifth step: and marking the history search record, returning to the first step, reading the data information initially submitted by the user, deleting the data information originally submitted by the user, searching the read data information initially submitted by the user in the history query set, and specially marking the data information initially submitted by the user in the history query set.
A data processing device facing big data is disclosed, as shown in FIG. 6, comprising an outer frame 1, wherein the outer frame 1 is in a hollow rectangular block shape, a control mainboard 2 is fixedly installed on the inner bottom wall of the outer frame 1, an input device 3 electrically connected with the control mainboard 2 is fixedly installed on the outer top wall of the outer frame 1, a control device 4 corresponding to the input device 3 is fixedly installed on the outer top wall of the outer frame 1, the control device 4 is electrically connected with the control mainboard 2, a display device 5 also electrically connected with the control mainboard 2 is fixedly installed at the middle position of the outer top wall of the outer frame 1, the display device 5 and the control mainboard 2 are electrically connected together, the input device 3 and the control device 4 are also electrically connected with the control mainboard 2, so that the content displayed inside the display device 5 can be controlled through the input device 3 and the control device 4, the top wall electric connection of control mainboard 2 has arithmetic device 6, and the top wall electric connection of frame 1 has storage device 7, and storage device 7 is inside to be provided with the database, through being in the same place arithmetic device 6 and storage device 7 and control mainboard 2 electric connection, and display device 5 is in the same place with control mainboard 2 electric connection, operates the data that will export through arithmetic device 6, makes control mainboard 2 can outwards export the inside content of storage device 7 through display device 5.
The working principle of the invention is as follows:
in the invention, the data information submitted by the user and needing to be searched is divided into a plurality of data information which are separately formed, or the user combines the plurality of data information which are separately formed into a plurality of pieces of data information in sequence, the data information which are separately formed is matched with the data information in the database according to the data information which is separately formed or the user combines the plurality of data information which are separately formed into a plurality of pieces of data information in sequence, a data preprocessing result set containing related objects or attributes in the database is directly output outwards, and the data information which is not searched is marked and stored in a history query set, the data information submitted by the user and needing to be searched is divided into a plurality of data information which are separately formed, or the user combines the plurality of data information which are separately formed into a plurality of pieces of data information in sequence, so that the data searching range is improved, the situation that the data cannot be found due to error recording of the user is avoided, meanwhile, the data which is not retrieved is recorded, the user can check the data which is not retrieved, and the user can conveniently find the data.
Example three: a big data oriented data processing method, as shown in fig. 3, includes the following steps:
the first step is as follows: a data search request, wherein data information to be searched is submitted by a user;
the second step is that: history information storage, and storing data information which is submitted by a user and needs to be searched in a history record set;
the third step: searching data information, inquiring the request condition to match with the object or attribute in the database, if the result is matched, jumping to the sixth step, calling a data preprocessing result set containing the related object or attribute in the database, and directly outputting the data preprocessing result set containing the related object or attribute in the database;
the fourth step: intercepting keywords, namely dividing data information which needs to be searched and is submitted by a user into a plurality of pieces of independent data information in sequence, or combining each piece of independent data according to the original data information which needs to be searched by the user, dividing the original required retrieval data information into a plurality of sections, retrieving the independent data information or one section of data information in sequence, jumping to the sixth step if matched data information exists, directly outputting a data preprocessing result set containing related objects or attributes in a database outwards, and marking data information which is not retrieved at the same time and storing the data information in a historical query set;
the fifth step: marking a history search record, returning to the first step, reading data information initially submitted by a user, deleting the data information originally submitted by the user, searching the read data information initially submitted by the user in a history query set, and specially marking the data information initially submitted by the user in the history query set;
and a sixth step: screening a data information range, searching a maximum value and a minimum value in the data output outwards, displaying the maximum value and the minimum value in the data output outwards, submitting the output range by a user, and directly screening the output data according to the range submitted by the user if the output range is not beyond the range; if the range is exceeded, outputting prompt information to enable the user to reselect the range, or enabling the user to submit specific information, and skipping the following steps to directly output the retrieved data; and let the user re-enter the range.
A data processing device facing big data is disclosed, as shown in FIG. 6, comprising an outer frame 1, wherein the outer frame 1 is in a hollow rectangular block shape, a control mainboard 2 is fixedly installed on the inner bottom wall of the outer frame 1, an input device 3 electrically connected with the control mainboard 2 is fixedly installed on the outer top wall of the outer frame 1, a control device 4 corresponding to the input device 3 is fixedly installed on the outer top wall of the outer frame 1, the control device 4 is electrically connected with the control mainboard 2, a display device 5 also electrically connected with the control mainboard 2 is fixedly installed at the middle position of the outer top wall of the outer frame 1, the display device 5 and the control mainboard 2 are electrically connected together, the input device 3 and the control device 4 are also electrically connected with the control mainboard 2, so that the content displayed inside the display device 5 can be controlled through the input device 3 and the control device 4, the top wall electric connection of control mainboard 2 has arithmetic device 6, and the top wall electric connection of frame 1 has storage device 7, and storage device 7 is inside to be provided with the database, through being in the same place arithmetic device 6 and storage device 7 and control mainboard 2 electric connection, and display device 5 is in the same place with control mainboard 2 electric connection, operates the data that will export through arithmetic device 6, makes control mainboard 2 can outwards export the inside content of storage device 7 through display device 5.
The working principle of the invention is as follows:
in the invention, the maximum value and the minimum value in the data output outwards are searched, the maximum value and the minimum value in the data output outwards are displayed, the user can submit the output range, if the output range is not beyond the range, the output data is directly screened according to the range submitted by the user, if the output range is beyond the range, prompt information is output, the user can reselect the range, or the user submits specific information, the screening is skipped, and the retrieved data is directly output, so that the user limits the range of the output data information, and the condition that the data searching speed of the user is slow due to excessive data with the same attribute is avoided.
Example four: a big data oriented data processing method, as shown in fig. 4, includes the following steps:
the first step is as follows: a data search request, wherein data information to be searched is submitted by a user;
the second step is that: history information storage, and storing data information which is submitted by a user and needs to be searched in a history record set;
the third step: searching data information, inquiring the request condition to match with the object or attribute in the database, if the result is matched, jumping to the sixth step, calling a data preprocessing result set containing the related object or attribute in the database, and directly outputting the data preprocessing result set containing the related object or attribute in the database;
the fourth step: intercepting keywords, namely dividing data information which needs to be searched and is submitted by a user into a plurality of pieces of independent data information in sequence, or combining each piece of independent data according to the original data information which needs to be searched by the user, dividing the original required retrieval data information into a plurality of sections, retrieving the independent data information or one section of data information in sequence, jumping to the sixth step if matched data information exists, directly outputting a data preprocessing result set containing related objects or attributes in a database outwards, and marking data information which is not retrieved at the same time and storing the data information in a historical query set;
the fifth step: marking a history search record, returning to the first step, reading data information initially submitted by a user, deleting the data information originally submitted by the user, searching the read data information initially submitted by the user in a history query set, and specially marking the data information initially submitted by the user in the history query set;
and a sixth step: screening a data information range, searching a maximum value and a minimum value in the data output outwards, displaying the maximum value and the minimum value in the data output outwards, submitting the output range by a user, and directly screening the output data according to the range submitted by the user if the output range is not beyond the range; if the range is exceeded, outputting prompt information to enable the user to reselect the range, or enabling the user to submit specific information, and skipping the following steps to directly output the retrieved data; then the user is enabled to input the range again;
the seventh step: and range information records, wherein the range records submitted by the user are stored in the range collection.
A data processing device facing big data is disclosed, as shown in FIG. 6, comprising an outer frame 1, wherein the outer frame 1 is in a hollow rectangular block shape, a control mainboard 2 is fixedly installed on the inner bottom wall of the outer frame 1, an input device 3 electrically connected with the control mainboard 2 is fixedly installed on the outer top wall of the outer frame 1, a control device 4 corresponding to the input device 3 is fixedly installed on the outer top wall of the outer frame 1, the control device 4 is electrically connected with the control mainboard 2, a display device 5 also electrically connected with the control mainboard 2 is fixedly installed at the middle position of the outer top wall of the outer frame 1, the display device 5 and the control mainboard 2 are electrically connected together, the input device 3 and the control device 4 are also electrically connected with the control mainboard 2, so that the content displayed inside the display device 5 can be controlled through the input device 3 and the control device 4, the top wall electric connection of control mainboard 2 has arithmetic device 6, and the top wall electric connection of frame 1 has storage device 7, and storage device 7 is inside to be provided with the database, through being in the same place arithmetic device 6 and storage device 7 and control mainboard 2 electric connection, and display device 5 is in the same place with control mainboard 2 electric connection, operates the data that will export through arithmetic device 6, makes control mainboard 2 can outwards export the inside content of storage device 7 through display device 5.
The working principle of the invention is as follows:
according to the method and the device, the maximum value and the minimum value in the data output outwards are searched, the maximum value and the minimum value in the data output outwards are displayed, the user can submit the output range, the range submitted by the user is stored in the range set, when the user does not have the data searched in the last range, the records are stored through the range set, and the situation that the user forgets is avoided.
Example five: a big data oriented data processing method, as shown in fig. 5, includes the following steps:
the first step is as follows: a data search request, wherein data information to be searched is submitted by a user;
the second step is that: history information storage, and storing data information which is submitted by a user and needs to be searched in a history record set;
the third step: searching data information, inquiring the request condition to match with the object or attribute in the database, if the result is matched, jumping to the sixth step, calling a data preprocessing result set containing the related object or attribute in the database, and directly outputting the data preprocessing result set containing the related object or attribute in the database;
the fourth step: intercepting keywords, namely dividing data information which needs to be searched and is submitted by a user into a plurality of pieces of independent data information in sequence, or combining each piece of independent data according to the original data information which needs to be searched by the user, dividing the original required retrieval data information into a plurality of sections, retrieving the independent data information or one section of data information in sequence, jumping to the sixth step if matched data information exists, directly outputting a data preprocessing result set containing related objects or attributes in a database outwards, and marking data information which is not retrieved at the same time and storing the data information in a historical query set;
the fifth step: marking a history search record, returning to the first step, reading data information initially submitted by a user, deleting the data information originally submitted by the user, searching the read data information initially submitted by the user in a history query set, and specially marking the data information initially submitted by the user in the history query set;
and a sixth step: screening a data information range, searching a maximum value and a minimum value in the data output outwards, displaying the maximum value and the minimum value in the data output outwards, submitting the output range by a user, and directly screening the output data according to the range submitted by the user if the output range is not beyond the range; if the range is exceeded, outputting prompt information to enable the user to reselect the range, or enabling the user to submit specific information, and skipping the following steps to directly output the retrieved data; then the user is enabled to input the range again;
the seventh step: range information records, storing the range records submitted by the user in a range collection set;
eighth step: and narrowing the screening range, searching the maximum value and the minimum value of the output data, and re-operating the sixth step, wherein when the prompt information is output, the range which causes the output prompt information is stored in the range aggregate.
A data processing device facing big data is disclosed, as shown in FIG. 6, comprising an outer frame 1, wherein the outer frame 1 is in a hollow rectangular block shape, a control mainboard 2 is fixedly installed on the inner bottom wall of the outer frame 1, an input device 3 electrically connected with the control mainboard 2 is fixedly installed on the outer top wall of the outer frame 1, a control device 4 corresponding to the input device 3 is fixedly installed on the outer top wall of the outer frame 1, the control device 4 is electrically connected with the control mainboard 2, a display device 5 also electrically connected with the control mainboard 2 is fixedly installed at the middle position of the outer top wall of the outer frame 1, the display device 5 and the control mainboard 2 are electrically connected together, the input device 3 and the control device 4 are also electrically connected with the control mainboard 2, so that the content displayed inside the display device 5 can be controlled through the input device 3 and the control device 4, the top wall electric connection of control mainboard 2 has arithmetic device 6, and the top wall electric connection of frame 1 has storage device 7, and storage device 7 is inside to be provided with the database, through being in the same place arithmetic device 6 and storage device 7 and control mainboard 2 electric connection, and display device 5 is in the same place with control mainboard 2 electric connection, operates the data that will export through arithmetic device 6, makes control mainboard 2 can outwards export the inside content of storage device 7 through display device 5.
The working principle of the invention is as follows:
in the invention, the maximum value and the minimum value of the output data are searched, the sixth step is operated again, when the prompt information is output, the range which causes the output of the prompt information is stored in the range collection to prompt the user, so that the condition that the user submits the information which exceeds the range for many times due to the change of the data is avoided, and the range of the data is limited for many times by operating the sixth step for many times, so that the range of the data output is smaller and smaller, and the search of the user is facilitated.
The foregoing shows and describes the general principles and broad features of the present invention and advantages thereof. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are described in the specification and illustrated only to illustrate the principle of the present invention, but that various changes and modifications may be made therein without departing from the spirit and scope of the present invention, which fall within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.
Claims (9)
1. A big data oriented data processing method is characterized in that: the method comprises the following steps:
the first step is as follows: a data search request;
the second step is that: storing historical information;
the third step: searching data information;
the fourth step: intercepting a keyword;
the fifth step: marking a historical search record;
and a sixth step: screening a data information range;
the seventh step: recording range information;
eighth step: the screening range is narrowed.
2. The big data oriented data processing method and device according to claim 1, wherein: the first step is to submit data information to be searched by a user;
and the second step is to store the data information which is submitted by the user and needs to be searched in a historical record set.
3. The big data oriented data processing method and device according to claim 1, wherein: and the third step of matching the query request condition with the object or attribute in the database, if the result is matched, jumping to the sixth step, calling a data preprocessing result set containing the related object or attribute in the database, and directly outputting the data preprocessing result set containing the related object or attribute in the database outwards.
4. The big data oriented data processing method and device according to claim 1, wherein: and the fourth step of dividing the data information which needs to be searched and is submitted by the user into a plurality of independent data information in sequence, or combining each independent data according to the original data information which needs to be searched by the user, dividing the original required retrieval data information into a plurality of sections, retrieving the independent data information or one section of data information in sequence, jumping to the sixth step if matched data information exists, directly outputting a data preprocessing result set containing related objects or attributes in the database outwards, marking the data information which is not retrieved, and storing the data information in the historical query set.
5. The big data oriented data processing method and device according to claim 1, wherein: and the fifth step returns to the first step, reads the data information initially submitted by the user, deletes the data information originally submitted by the user, searches the read data information initially submitted by the user in the historical query set, and specially marks the data information initially submitted by the user in the historical query set.
6. The big data oriented data processing method and device according to claim 1, wherein: searching the maximum value and the minimum value in the data output outwards, displaying the maximum value and the minimum value in the data output outwards, submitting an output range by a user, and directly screening the output data according to the range submitted by the user if the output range is not exceeded; if the range is exceeded, outputting prompt information to enable the user to reselect the range, or enabling the user to submit specific information, and skipping the following steps to directly output the retrieved data; and let the user re-enter the range.
7. The big data oriented data processing method and device according to claim 1, wherein: the seventh step is to store the range records submitted by the user in a range collection;
and the eighth step of searching the maximum value and the minimum value of the output data, re-operating the sixth step, and storing the range causing the output of the prompt information into a range convergence when the prompt information is output.
8. A big-data-oriented data processing apparatus comprising an outer frame (1), characterized in that: frame (1) is the cavity rectangular block shape, and the inside bottom wall fixed mounting of frame (1) has control mainboard (2), and the outside top wall fixed mounting of frame (1) has input device (3) together with control mainboard (2) electric connection, and the outside top wall fixed mounting of frame (1) has controlling means (4) that correspond each other with input device (3), and controlling means (4) and control mainboard (2) electric connection together.
9. A big-data oriented data processing apparatus according to claim 8, wherein: the display device is characterized in that a display device (5) which is electrically connected with the control main board (2) is fixedly mounted in the middle of the external top wall surface of the outer frame (1), the top wall surface of the control main board (2) is electrically connected with an arithmetic device (6), the top wall surface of the outer frame (1) is electrically connected with a storage device (7), and a database is arranged inside the storage device (7).
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111295428.XA CN114020800A (en) | 2021-11-03 | 2021-11-03 | A data processing method and device for big data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111295428.XA CN114020800A (en) | 2021-11-03 | 2021-11-03 | A data processing method and device for big data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114020800A true CN114020800A (en) | 2022-02-08 |
Family
ID=80060426
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111295428.XA Pending CN114020800A (en) | 2021-11-03 | 2021-11-03 | A data processing method and device for big data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114020800A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010131013A1 (en) * | 2009-05-15 | 2010-11-18 | British Telecommunications Public Limited Company | Collaborative search engine optimisation |
| CN102033913A (en) * | 2009-09-30 | 2011-04-27 | 卡西欧计算机株式会社 | Electronic dictionary and display control method for dictionary information |
| CN104424215A (en) * | 2013-08-23 | 2015-03-18 | 腾讯科技（深圳）有限公司 | Data search method and search server |
| CN104820699A (en) * | 2015-05-08 | 2015-08-05 | 上海玖道信息科技股份有限公司 | Intelligent site selecting tracking system |
| CN111767445A (en) * | 2020-06-29 | 2020-10-13 | 平安科技（深圳）有限公司 | Data search method, apparatus, computer equipment and storage medium |
-
2021
- 2021-11-03 CN CN202111295428.XA patent/CN114020800A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010131013A1 (en) * | 2009-05-15 | 2010-11-18 | British Telecommunications Public Limited Company | Collaborative search engine optimisation |
| CN102033913A (en) * | 2009-09-30 | 2011-04-27 | 卡西欧计算机株式会社 | Electronic dictionary and display control method for dictionary information |
| CN104424215A (en) * | 2013-08-23 | 2015-03-18 | 腾讯科技（深圳）有限公司 | Data search method and search server |
| CN104820699A (en) * | 2015-05-08 | 2015-08-05 | 上海玖道信息科技股份有限公司 | Intelligent site selecting tracking system |
| CN111767445A (en) * | 2020-06-29 | 2020-10-13 | 平安科技（深圳）有限公司 | Data search method, apparatus, computer equipment and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 张燕妮等: "Piazza问答平台与Open edX平台的集成", 计算机工程与科学, vol. 40, no. 5, 31 May 2018 (2018-05-31), pages 813 - 820 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107491487B (en) | A full-text database architecture and bitmap index creation, data query method, server and medium | |
| US7324991B1 (en) | Sampling in a multidimensional database | |
| US6122644A (en) | System for halloween protection in a database system | |
| JP6346218B2 (en) | Search method, apparatus and server for online trading platform | |
| CN113010484A (en) | Log file management method and device | |
| US10990573B2 (en) | Fast index creation system for cloud big data database | |
| WO2023086322A1 (en) | Late materialization of queried data in database cache | |
| CN114020800A (en) | A data processing method and device for big data | |
| CN109299106B (en) | Data query method and device | |
| CN111666302A (en) | User ranking query method, device, equipment and storage medium | |
| US11841841B2 (en) | Stand in tables | |
| JP2009294723A (en) | Search result display method, search device and computer program | |
| CN116401245A (en) | A data index construction method and system | |
| JPH01296339A (en) | Data retrieving system | |
| JPH08255170A (en) | Retrieval processor with sorting | |
| JP2001067369A (en) | Information retrieval system, information retrieval method and recording medium recording information retrieval probram | |
| CN113127500B (en) | Paging query method, electronic device and computer-readable storage medium | |
| JPH01241640A (en) | Data base device and data base managing method | |
| JPS61141035A (en) | Data retrieval system | |
| JPH04156624A (en) | High speed accessing systme in knowledge base systme | |
| JPH10254887A (en) | Data base system | |
| JP2002304403A (en) | Database management method and system, processing program therefor, and recording medium storing the processing program | |
| CN118689991A (en) | Document-based intelligent question-answering method, device, electronic device, and storage medium | |
| JPH0764835A (en) | Data storage system for relational data base | |
| TW202223685A (en) | Knowledge graph association search method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |