[go: up one dir, main page]

skip to main content
10.1145/1890799.1890805acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmiddlewareConference Proceedingsconference-collections
research-article

Optimizing the pre-processing of scientific visualization techniques using QEF

Published: 29 November 2010 Publication History

Abstract

Scientific Visualization is a computer-based field concerned with techniques that allow scientists to create graphical representations from datasets generated by computational simulations or acquisition instruments. To address the computational cost of visualization tasks, specially for large datasets, researchers have explored grid environments as a platform for their parallel evaluation. It is however not trivial to adapt each different visualization technique to run in grid environments. A desirable alternative would separate the specificities of data and process distribution in grids from visualization computation logic. In this work we claim that the QEF (query evaluation framework) leverages scientific visualization computation with the above mentioned characteristics. Visualization computation techniques are modeled as operators in an algebra and integrated with a set of control operators that manage data distribution leading to a parallel QEP (query execution plan). We show the benefits of parallelization for two of those techniques: particle tracing and volume rendering. For these techniques, our experiments demonstrate many positive aspects of the solution presented, as well as opportunities for future work.

References

[1]
E. W. Bethel and J. Shalf. Grid-distributed visualizations using connectionless protocols. pages 23(2):51--59. IEEE Computer Society, Graph. Appl., 2003.
[2]
D. Borthakur. The Hadoop Distributed File System: Architecture and Design. The Apache Software Foundation, 2007.
[3]
S. P. Callahan, J. Freire, E. Santos, C. E. Scheidegger, C. T. Silva, and H. T. Vo. Vistrails: visualization meets data management. In SIGMOD Conference, pages 745--747, 2006.
[4]
V. F. V. da Silva and R. N. Melo. Qeef-g: The parallel execution of iterative queries, 2006.
[5]
J. Dean and S. Ghemawat. Mapreduce: a flexible data processing tool. Commun. ACM, 53(1):72--77, 2010.
[6]
I. Foster, C. Kesselman, J. Nick, and S. Tuecke. The physiology of the grid: An open grid services architecture for distributed systems integration, 2002.
[7]
G. Giraldi, J. Oliveira, B. Schulze, and R. Silva. Distributed visualization of fluids using grid. In In Proc. Of the International Middleware Conference (MGC), 2003.
[8]
C. Hansen and C. Johnson. Guest editors introduction: Graphics applications for grid computing. In IEEE Comput. Graph. Applications. Special Issue., pages 20--21, 2003.
[9]
M. Isard, M. Budiu, Y. Yu, A. Birrell, and D. Fetterly. Dryad: distributed data-parallel programs from sequential building blocks. In EuroSys '07: Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007, pages 59--72, New York, NY, USA, 2007. ACM.
[10]
D. Kranzlmuller, P. Heinzlreiter, and J. Volkert. Grid-enabled visualization with gvk. In Proceedings of the First European Across Grids Conference, 2003.
[11]
M.-L. Lo and C. V. Ravishankar. Spatial hash-joins. SIGMOD Rec., 25(2):247--258, 1996.
[12]
K.-L. Ma. Parallel volume ray-casting for unstructured-grid data on distributed-memory architectures. In PRS '95: Proceedings of the IEEE symposium on Parallel rendering, pages 23--30, New York, NY, USA, 1995. ACM.
[13]
M. T. Ozsu and P. Valduriez. Principles of Distributed Database Systems (2nd Edition). Prentice Hall, 2 edition, January 1999.
[14]
F. Porto, V. F. V. D. Silva, M. L. Dutra, and B. Schulze. An adaptive distributed query processing grid service. In Proceedings of the Workshop on Data Management in Grids, VLDB2005, pages 45--57. Springer-Verlag, 2005.
[15]
F. Porto, O. Tajmouati, V. F. V. D. Silva, B. Schulze, and F. V. M. Ayres. Qef - supporting complex query applications. In CCGRID '07: Proceedings of the Seventh IEEE International Symposium on Cluster Computing and the Grid, pages 846--851. IEEE Computer Society, 2007.
[16]
L. Rosenblum, R. Earnshaw, J. Encarnacao, H. Hagen, S. Klimenko, D. Thalmann, G. Nielson, and F. Post. Scientific Visualization: Advances and Challenges. Academic Press, 1994.

Cited By

View all
  • (2013)Chiron: a parallel engine for algebraic scientific workflowsConcurrency and Computation: Practice and Experience10.1002/cpe.303225:16(2327-2341)Online publication date: 10-May-2013

Index Terms

  1. Optimizing the pre-processing of scientific visualization techniques using QEF

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    MGC '10: Proceedings of the 8th International Workshop on Middleware for Grids, Clouds and e-Science
    November 2010
    64 pages
    ISBN:9781450304535
    DOI:10.1145/1890799
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    • Professional
    • USENIX Assoc: USENIX Assoc
    • IFIP

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 November 2010

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. grids
    2. middleware
    3. parallelization
    4. query optmization
    5. scientific visualization

    Qualifiers

    • Research-article

    Conference

    Middleware '10
    Sponsor:
    • USENIX Assoc
    Middleware '10: 11th International Middleware Conference
    November 29 - December 3, 2010
    Bangalore, India

    Acceptance Rates

    Overall Acceptance Rate 14 of 36 submissions, 39%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 07 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2013)Chiron: a parallel engine for algebraic scientific workflowsConcurrency and Computation: Practice and Experience10.1002/cpe.303225:16(2327-2341)Online publication date: 10-May-2013

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media