Space odyssey: efficient exploration of scientific data
File(s)Voyager.pdf (1.05 MB)
Accepted version
Author(s)
Pavlovic, Mirjana
Zacharatou, Eleni Tzirita
Sidlauskas, Darius
Heinis, Thomas
Ailamaki, Anastasia
Type
Conference Paper
Abstract
Advances in data acquisition---through more powerful supercomputers for simulation or sensors with better resolution---help scientists tremendously to understand natural phenomena. At the same time, however, it leaves them with a plethora of data and the challenge of analysing it. Ingesting all the data in a database or indexing it for an efficient analysis is unlikely to pay off because scientists rarely need to analyse all data. Not knowing a priori what parts of the datasets need to be analysed makes the problem challenging. Tools and methods to analyse only subsets of this data are rather rare. In this paper we therefore present Space Odyssey, a novel approach enabling scientists to efficiently explore multiple spatial datasets of massive size. Without any prior information, Space Odyssey incrementally indexes the datasets and optimizes the access to datasets frequently queried together. As our experiments show, through incrementally indexing and changing the data layout on disk, Space Odyssey accelerates exploratory analysis of spatial data by substantially reducing query-to-insight time compared to the state of the art.
Editor(s)
Roy, SB
Stefanidis, K
Koutrika, G
Riedewald, M
Lakshmanan, LVS
Date Issued
2016
Date Acceptance
2016-06-01
Citation
Proceedings of the Third International Workshop on Exploratory Search in Databases and the Web, San Francisco, CA, USA, July 1, 2016, 2016, pp.12-18
ISBN
978-1-4503-4312-1
Publisher
ACM
Start Page
12
End Page
18
Journal / Book Title
Proceedings of the Third International Workshop on Exploratory Search in Databases and the Web, San Francisco, CA, USA, July 1, 2016
Copyright Statement
© 2016 ACM. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ExploreDB '16 Proceedings of the Third International Workshop on Exploratory Search in Databases and the Web
Pages 12-18, https://dx.doi.org/10.1145/2948674.2948677
Pages 12-18, https://dx.doi.org/10.1145/2948674.2948677
Sponsor
Engineering & Physical Science Research Council (E
European Research Office
Identifier
http://doi.acm.org/10.1145/2948674
Grant Number
EP/N023242/1
720270
Source
ExploreDB '16 Proceedings of the Third International Workshop on Exploratory Search in Databases and the Web
Publication Status
Published
Start Date
2016-06-26
Finish Date
2016-07-01
Coverage Spatial
San Francisco, California
Date Publish Online
2016-06-26