CN106560792B - Double-cache surface element calculation method for mass observation system - Google Patents
Double-cache surface element calculation method for mass observation system Download PDFInfo
- Publication number
- CN106560792B CN106560792B CN201510987317.3A CN201510987317A CN106560792B CN 106560792 B CN106560792 B CN 106560792B CN 201510987317 A CN201510987317 A CN 201510987317A CN 106560792 B CN106560792 B CN 106560792B
- Authority
- CN
- China
- Prior art keywords
- surface element
- cache
- data
- observation system
- memory
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004364 calculation method Methods 0.000 title claims abstract description 45
- 238000000034 method Methods 0.000 claims abstract description 32
- 230000000903 blocking effect Effects 0.000 claims abstract description 4
- 238000012163 sequencing technique Methods 0.000 claims abstract description 4
- 230000001174 ascending effect Effects 0.000 claims description 5
- 238000010276 construction Methods 0.000 abstract description 2
- 238000012544 monitoring process Methods 0.000 abstract description 2
- 238000003860 storage Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000009826 distribution Methods 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000007429 general method Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000000638 solvent extraction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5072—Grid computing
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Mathematical Physics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Geophysics And Detection Of Objects (AREA)
Abstract
The invention discloses a double-cache surface element calculation method for a mass observation system, which comprises the following steps: acquiring the grid attribute of a surface element of the observation system, and numbering the surface elements along the Inline direction; calculating the coverage times of the observation system surface element; through self-adaptive memory allocation; dividing the number of the whole surface element of the observation system into blocks in different ranges according to the surface element covering times and the memory cache size; calculating the total number of the surface element attribute data according to the number of the surface element number blocks and the size of a memory cache block, and initializing a surface element attribute data cache file according to the total number; according to observation system data, surface element grid information and surface element number blocking information, calculating surface element shot-geophone distance and azimuth data in blocks and sequencing; and storing the memory cache data of the block into the file cache according to the position of the current block in the file cache. The method has low requirements on computer hardware, particularly memory, and is suitable for surface element theoretical calculation of an observation system before seismic acquisition and quality monitoring of actual acquisition in the field construction process.
Description
Technical Field
The invention belongs to the technical field of seismic acquisition, and particularly relates to a double-cache surface element calculation method for a mass observation system in field seismic acquisition design and actual production processes.
Background
With the continuous development of seismic acquisition technology and equipment, seismic exploration acquisition develops towards the direction of high precision, high density and high resolution. With the application of high density acquisition, the amount of data generated by acquisition of P1/90 or SPS observation systems has multiplied, reaching tens of GB. Due to the increase of data volume, the limitation of a computer physical memory and the limitation of a 32-bit operating system on the management capability of the physical memory, the calculation of a large number of observation system bins cannot be completed by adopting a general method for caching the calculation result of the bin attribute data of the observation system by using the memory, and a new calculation method must be adopted to realize the purpose that the common computer completes the bin calculation of the large number of observation system data.
Disclosure of Invention
Aiming at the technical problems, the invention aims to provide a method for completing the bin calculation of a mass observation system by a computer which is suitable for different hardware configurations, the method has strong adaptability and low requirements on computer hardware, particularly memory, and is suitable for the bin theoretical calculation of the observation system before earthquake acquisition and the bin calculation of the observation system in the field construction process.
In order to achieve the purpose, the technical scheme of the invention is as follows:
the method for calculating the double-cache surface element of the mass observation system is characterized by comprising the following steps of:
s01: dividing the element grid of the observation system by setting element grid origin coordinates, element grid directions and element grid sizes, wherein the elements are numbered from 0 according to the Inline direction;
s02: calculating the coverage times of the observation system surface elements, and calculating the total coverage times N of all the surface elements;
s03: self-adaptively allocating a memory and allocating a proper memory cache;
s04: dividing the surface element data into blocks, calculating the offset and azimuth data size of each surface element as 2 covering times 4 (unit: byte) according to the covering times, and calculating the surface element range which can be stored by the allocated memory cache according to the surface element number according to the data size of each surface element;
s05: calculating the total data volume of the surface element attribute data according to the number of the surface element blocks and the size of a memory cache block, and initializing a surface element attribute file according to the data volume;
s06: calculating bin shot-geophone range and azimuth data in blocks according to observation system data, bin grid information and bin number blocking information;
s07: sorting the shot-geophone distances and azimuth angles according to the ascending order of the shot-geophone distances;
s08: and storing the data in the memory cache of the current block into the file cache according to the position of the current block in the file cache.
Preferably, after the surface element meshing is completed in step S01, numbering is performed in order from 0 in the Inline direction.
Preferably, the method for adaptively allocating memory in step S03 includes, according to a total memory situation of the PC, using 1/4 or 1/8 of the total memory size as the size of the memory cache; or a dynamic allocation mode is adopted, and according to the actual available physical memory quantity, a proper memory cache is applied according to the integral multiple of 8MB (8X1024X1024 bytes).
Preferably, in step S06, the calculation result data in the calculation process is stored in a memory cache, and after the calculation of the bin data in one block is completed, the calculated result data is stored in a bin attribute data cache file.
Preferably, in step S07, a fast sorting algorithm is applied to sort the offset and azimuth data in ascending order of offset.
Compared with the prior art, the invention has the beneficial effects that:
1. the method realizes that the common computer completes the bin analysis of the mass observation system, and achieves the purpose that the common computer completes the mass data volume calculation and the calculation result storage by adopting a double-cache mode, namely a mode of memory cache and disk file cache, on the premise of not influencing or slightly influencing the calculation efficiency. The method comprises the following steps that a physical memory available for a computer is used as result data in a calculation process for temporary storage, the memory adopts a self-adaptive distribution mode, and the size of the physical memory to be distributed is automatically calculated according to the physical memory available for the computer at present; the disk file is used for storing final result data calculated in the memory.
2. The method is used for performing surface element calculation of the observation system, has low requirement on computer hardware and wide application range, and can be applied to seismic acquisition theoretical design and real-time quality monitoring in the field acquisition process.
Drawings
FIG. 1 is a functional schematic diagram of a dual-cache bin calculation method of a mass observation system according to the present invention;
FIG. 2 is a flowchart of a dual-cache bin calculation method of a mass observation system according to the present invention;
fig. 3 is a schematic diagram of binning meshing and binning numbering in the dual-cache binning calculation method for the mass observation system according to the present invention;
fig. 4 is a schematic diagram illustrating distribution of the bin coverage times of the method for calculating the double-cache bins of the mass observation system according to the present invention;
FIG. 5 is a flow chart of memory allocation caching in the method for computing double-caching surface elements of a mass observation system according to the present invention;
FIG. 6 is a schematic view of a bin data block of the method for calculating double-cache bins of a mass observation system according to the present invention;
fig. 7 is a schematic view of storing bin data in the method for calculating double-cache bins of the mass observation system according to the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the following detailed description and accompanying drawings. It should be understood that the description is intended to be exemplary only, and is not intended to limit the scope of the present invention. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present invention.
Example (b):
as shown in fig. 1, the method for calculating the double-cache surface element of the mass observation system mainly aims to realize that a common computer completes surface element analysis of the mass observation system, and the method realizes that a double-cache mode, namely a mode of memory cache and disk file cache, is adopted on the premise of not influencing or less influencing the calculation efficiency, so that the common PC completes calculation of a large amount of data and storage of a calculation result. The method comprises the following steps that a physical memory available for a computer is used as result data in a calculation process to be temporarily stored so as to improve data storage speed, and the size of the physical memory to be allocated is automatically calculated according to the physical memory available for the computer at present in a self-adaptive allocation mode; the disk file is used for storing final result data calculated in the memory.
The calculation flow of the mass observation system double-cache bin calculation method is shown in fig. 2, and includes: the method comprises the following steps of bin gridding and bin numbering S01, bin covering times calculation S02, memory self-adaption distribution S03, bin data partitioning S04, bin attribute data file initialization S05, block calculation of shot-geophone distance and azimuth S06, shot-geophone distance and azimuth sorting S07, and storage of shot-geophone distance and azimuth data S08.
Binning meshing S01
Before the calculation of the bin attributes, the bin grids of the observation system must be divided, and the bin grids are obtained by setting attributes such as the coordinates of the origin of the bin grids, the direction (north 0 degree) of the bin grids, the size of the bin grids and the like. As shown in fig. 3, after the meshing is completed, numbering starts from 0 in the Inline direction.
Calculating the number of observation system bin coverage S02
As shown in fig. 4, after the binning meshing is completed, the coverage number of the observation system is calculated according to the method for calculating the coverage number of the observation system, after the calculation is completed, the coverage number in each bin is obtained, and the total number N of the coverage numbers of all the bins is calculated.
Allocating adaptive memory cache S03
When the memory cache is allocated, according to the total memory condition of the computer, 1/4 or 1/8 of the total memory size is used as the size of the memory cache; or a dynamic allocation mode is adopted, the maximum memory cache is allocated according to the actual available physical memory amount and the integral multiple of 8MB (8X1024 bytes), as shown in fig. 5, the memory allocation is circularly performed until a proper memory block is allocated.
Binning S04
The coverage number calculation is analyzed according to the data of the observation system, the coverage number of each surface element in the surface elements of the observation system can be calculated, the offset and azimuth data size in each surface element is 2 × 4 (unit: byte) according to the coverage number, the surface element range which can be stored by the allocated memory cache is calculated according to the surface element number according to the data size in each surface element, and the data size of the offset and azimuth data of all the surface elements in the range is smaller than or equal to the memory cache size, as shown in fig. 6.
Initializing bin attribute data cache file S05
And (3) calculating the total data size (total data size = block number X block size) (unit: byte) of the surface element attribute data according to the surface element block number and the size of the memory cache block, and initializing a surface element attribute file according to the data size.
Block calculation bin offset and azimuth data S06
Calculating the bin offset and azimuth data according to data such as observation system data, bin grid information, bin number block information and the like, storing the calculated result data in a memory cache in the calculation process, and storing the result data in a bin attribute data cache file after the bin data in one block is calculated.
Binning offset and azimuth data sorting S07
And after the shot-geophone distance and azimuth data of each segmented surface element are calculated, sequencing the shot-geophone distance and azimuth data in each surface element in an ascending order of the shot-geophone distance by applying a quick sequencing algorithm.
Saving the metadata to a cache file S08
As shown in fig. 7, after the offset and azimuth data of a block are calculated, the data in the memory cache of the block is stored in the file cache according to the position of the current memory cache block in the file cache.
And finishing the bin calculation of the observation system after finishing the calculation of the bin attribute data of all the observation systems.
The method adopts a memory + disk file mode to manage mass observation system surface element attribute data, and if the space of a disk is large enough, the method can calculate the observation system surface element with any size; the method changes the common mode of managing the surface element attribute data by the memory, and reduces the requirement of the surface element calculation of the mass observation system on the memory of the computer by adopting a double-cache mode, thereby realizing the purpose of finishing the surface element data calculation of the mass observation system by the common computer.
It is to be understood that the above-described embodiments of the present invention are merely illustrative of or explaining the principles of the invention and are not to be construed as limiting the invention. Therefore, any modification, equivalent replacement, improvement and the like made without departing from the spirit and scope of the present invention should be included in the protection scope of the present invention. Further, it is intended that the appended claims cover all such variations and modifications as fall within the scope and boundaries of the appended claims or the equivalents of such scope and boundaries.
Claims (4)
1. A method for calculating double-cache surface elements of a mass observation system is characterized by being suitable for realizing surface element calculation of the mass observation system under different computer hardware conditions, and comprises the following steps:
s01: dividing the surface element grids of the observation system by setting the coordinates of the origin of the surface element grids, the directions of the surface element grids and the sizes of the surface element grids, and numbering the surface element according to the Inline direction of the grids;
s02: calculating the coverage times of the observation system surface element, and calculating the total number N of the coverage times;
s03: self-adaptively allocating a memory and allocating a proper memory cache;
s04: dividing the surface elements into blocks, calculating the data size of the offset and azimuth in each surface element as 2 bytes of covering times and 2 bytes of covering times according to the data size in each surface element, and calculating the surface element range which can be stored by the memory cache according to the sequence of the surface elements, wherein the data amount of the offset and azimuth data of all the surface elements in the range is less than or equal to the memory cache size;
s05: calculating the total data volume of the surface element attribute data according to the number of the surface element blocks and the size of a memory cache block, and initializing a surface element attribute file according to the data volume;
s06: calculating bin shot-geophone distance and azimuth data according to blocks according to observation system data, bin grid information and bin number blocking information, storing calculation result data in a calculation process in a memory cache, and storing the calculated result data in a bin attribute data cache file after the bin data in one blocking is calculated;
s07: sequencing the shot-geophone distances and azimuth angles of each bin according to the shot-geophone distance ascending sequence;
s08: and storing the data in the internal memory cache of the current block to the corresponding position of the file according to the position of the current block in the cache file.
2. The mass observation system double-cache bin calculation method according to claim 1, wherein in step S01, after the bin meshing is completed, bins are numbered sequentially starting from 0 along an Inline direction.
3. The mass observation system double-cache bin calculation method according to claim 1, wherein the method for adaptively allocating memory in step S03 includes adopting 1/4 or 1/8 of memory size as the size of the memory cache according to the memory condition of the computer; or a dynamic allocation mode is adopted, and the proper memory cache is allocated according to the integral multiple of 8MB according to the actual available physical memory amount.
4. The method for calculating double-cache bins of mass observation systems according to claim 1, wherein a fast sorting algorithm is applied in step S07 to sort the offset and azimuth data in each bin in ascending order of offset.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510987317.3A CN106560792B (en) | 2015-12-27 | 2015-12-27 | Double-cache surface element calculation method for mass observation system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510987317.3A CN106560792B (en) | 2015-12-27 | 2015-12-27 | Double-cache surface element calculation method for mass observation system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106560792A CN106560792A (en) | 2017-04-12 |
| CN106560792B true CN106560792B (en) | 2020-05-01 |
Family
ID=58485470
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510987317.3A Active CN106560792B (en) | 2015-12-27 | 2015-12-27 | Double-cache surface element calculation method for mass observation system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106560792B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1533754A1 (en) * | 2003-10-03 | 2005-05-25 | J.O.A. Beheer B.V. | Method and apparatus for modelling multidimensional, heterogeneous structures by computer |
| US8352191B2 (en) * | 2009-01-02 | 2013-01-08 | Landis+Gyr, Inc. | Seismic detection in electricity meters |
| CN103605161A (en) * | 2013-10-29 | 2014-02-26 | 中国石油天然气集团公司 | Analysis method and device for common-mid-point binning properties of earthquake three-dimensional observation system |
| CN104133240A (en) * | 2014-07-29 | 2014-11-05 | 中国石油天然气集团公司 | Large-scale collateral kirchhoff prestack depth migration method and device |
| CN104570068A (en) * | 2013-10-11 | 2015-04-29 | 中国石油化工股份有限公司 | Observation system CRP (commercial rent planning) attributive analysis method based on three-dimensional GIS (geographic information system) |
| CN105093283A (en) * | 2014-05-16 | 2015-11-25 | 中国石油化工股份有限公司 | Three-dimensional observation system surface element attribute multi-thread rapid display method |
-
2015
- 2015-12-27 CN CN201510987317.3A patent/CN106560792B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1533754A1 (en) * | 2003-10-03 | 2005-05-25 | J.O.A. Beheer B.V. | Method and apparatus for modelling multidimensional, heterogeneous structures by computer |
| US8352191B2 (en) * | 2009-01-02 | 2013-01-08 | Landis+Gyr, Inc. | Seismic detection in electricity meters |
| CN104570068A (en) * | 2013-10-11 | 2015-04-29 | 中国石油化工股份有限公司 | Observation system CRP (commercial rent planning) attributive analysis method based on three-dimensional GIS (geographic information system) |
| CN103605161A (en) * | 2013-10-29 | 2014-02-26 | 中国石油天然气集团公司 | Analysis method and device for common-mid-point binning properties of earthquake three-dimensional observation system |
| CN105093283A (en) * | 2014-05-16 | 2015-11-25 | 中国石油化工股份有限公司 | Three-dimensional observation system surface element attribute multi-thread rapid display method |
| CN104133240A (en) * | 2014-07-29 | 2014-11-05 | 中国石油天然气集团公司 | Large-scale collateral kirchhoff prestack depth migration method and device |
Non-Patent Citations (2)
| Title |
|---|
| 三位地震数据体多分辨率数据组织与管理技术研究;魏佳 等;《石油物探》;20100531;第49卷(第3期);全文 * |
| 海量地震数据三位可视化技术探讨;孟黎歌;《中国地球科学联合学术年会》;20141231;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106560792A (en) | 2017-04-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10055810B2 (en) | Cache architecture for efficiently accessing texture data using buffers | |
| EP3073364A1 (en) | Caching and tiering for cloud storage | |
| CN113190515B (en) | Coordinate Transformation Method of City-Level Massive Point Cloud Based on Heterogeneous Parallel Computing | |
| KR20200105630A (en) | Methods and apparatus to store and access multi-dimensional data | |
| EP2645259A1 (en) | Method, device and system for caching data in multi-node system | |
| EP3528124A3 (en) | Partition tolerance in cluster membership management | |
| JP2010033561A (en) | Method and apparatus for partitioning and sorting data set on multiprocessor system | |
| CN102565854A (en) | Mass data GPU (graphics processing unit) wave equation reverse time migration imaging method | |
| CN110187968B (en) | Graph data processing acceleration method in heterogeneous computing environment | |
| Han et al. | Development of a hashing-based data structure for the fast retrieval of 3D terrestrial laser scanned data | |
| CN104502967B (en) | The method and device of quick obtaining seismic prospecting observation system bin information | |
| CN101937555B (en) | Parallel generation method of pulse compression reference matrix based on GPU (Graphic Processing Unit) core platform | |
| Stojanovic et al. | High performance processing and analysis of geospatial data using CUDA on GPU | |
| CN106560792B (en) | Double-cache surface element calculation method for mass observation system | |
| CN111090759B (en) | Algorithm for cross-stage loading of massive real-scene big data | |
| CN104714898A (en) | Cache allocation method and device | |
| EP3182299A3 (en) | Methods and systems for estimating the number of points in two-dimensional data | |
| CN106897131A (en) | A kind of parallel calculating method and its device for astronomical software Gridding | |
| CN114066739B (en) | Background point cloud filtering method and device, computer equipment and storage medium | |
| Yao et al. | China data cube (CDC) for big Earth observation data: Lessons learned from the design and implementation | |
| CN107229573B (en) | Elastic high-availability caching method based on solid state disk | |
| CN104050189B (en) | The page shares processing method and processing device | |
| CN105551310B (en) | A fast addressing method for forward-looking early warning based on terrain database | |
| CN107239559B (en) | Method for calculating position of space moving target based on vector grid | |
| US9740626B2 (en) | Sharing data structures between processes by semi-invasive hybrid approach |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20231009 Address after: Room 1006A, 9th Floor, Building 2, No. 66 Zhongguancun East Road, Haidian District, Beijing Patentee after: BEIJING C0-SAIL PETROLEUM TECHNOLOGY CO.,LTD. Address before: Room 902C, Building 1, Yard 1, Shangdi East Road, Haidian District, Beijing, 100085 Patentee before: BEIJING KESHENG YONGCHANG SOFTWARE CO.,LTD. |
|
| TR01 | Transfer of patent right |