A cost model for long-term compressed data retention
Conference item
Liao, Kewen, Moffat, Alistair, Petri, Matthias and Wirth, Anthony. (2017). A cost model for long-term compressed data retention. 10th International Conference on Web Search and Data Mining. United States of America: Association for Computing Machinery. pp. 241 - 249 https://doi.org/10.1145/3018661.3018738
Authors | Liao, Kewen, Moffat, Alistair, Petri, Matthias and Wirth, Anthony |
---|---|
Abstract | Vast amounts of data are collected and stored every day, as part of corporate knowledge bases and as a response to legislative compliance requirements. To reduce the cost of retaining such data, compression tools are often applied. But simply seeking the best compression ratio is not necessarily the most economical choice, and other factors also come in to play, including compression and decompression throughput, the main memory required to support a given level of on-going access to the stored data, and the types of storage available. Here we develop a model for the total retention cost (TRC) of a data archiving regime, and by applying the charging rates associated with a cloud computing provider, are able to derive dollar amounts for a range of compression options, and hence guide the development of new approaches that are more cost-effective than current mechanisms. In particular, we describe an enhancement to the Relative Lempel Ziv (RLZ) compression scheme, and show that in terms of TRC, it outperforms previous approaches in terms of providing economical long-term data retention |
Year | 2017 |
Journal | Proceedings of the Tenth ACM International Conference on Web Search and Data Mining (WSDM '17) |
Publisher | Association for Computing Machinery |
Digital Object Identifier (DOI) | https://doi.org/10.1145/3018661.3018738 |
Publisher's version | File Access Level Controlled |
Page range | 241 - 249 |
Research Group | Peter Faber Business School |
Place of publication | United States of America |
https://acuresearchbank.acu.edu.au/item/863v2/a-cost-model-for-long-term-compressed-data-retention
Restricted files
Publisher's version
116
total views0
total downloads0
views this month0
downloads this month