Data Interface All-iN-A-Place (DIANA) for Big Data

Frank Zhigang Wang, Theo Dimitrakos, Na Helian, Sining Wu, Yuhui Deng, Ling Li, Rodric Yates

Research output: Chapter in Book/Report/Conference proceedingConference contribution

116 Downloads (Pure)

Abstract

Variety in Big Data means we have a wide range of data types and sources: e.g. File systems and database systems co-exist for decades as two popular data-accessing interfaces. This work is to unify these two interfaces by presenting a Data Interface All-iN-A-place (DIANA). The first challenge lies in distinguishing structured and un-structured data and diverting them to different underlying platforms. It is demonstrated that a speedup of 5000 in indexing has been achieved at the expense of a slowdown of 100 in extracting attributes. A DIANA-based cloud storage system is constructed for versatile, long distance and large volume big data accessing operations to address "Volume" and "Velocity" in Big Data. It encapsulates a dynamic multi-stream/multi-path engine at the socket level, which conforms to Portable Operating System Interface (POSIX).
Original languageEnglish
Title of host publicationTrust, Security and Privacy in Computing and Communications (TrustCom), 2014 IEEE 13th International Conference on
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages665-672
Number of pages7
ISBN (Electronic)978-1-4799-6513-7
ISBN (Print)978-1-4799-6513-7
DOIs
Publication statusPublished - Sept 2014
Event2014 IEEE 13th International Conference on Trust, Security and Privacy in Computing and Communications - Beijing, China
Duration: 24 Sept 201426 Sept 2014

Conference

Conference2014 IEEE 13th International Conference on Trust, Security and Privacy in Computing and Communications
Abbreviated titleTrustCom
Country/TerritoryChina
CityBeijing
Period24/09/1426/09/14

Keywords

  • Big data
  • variety
  • volume
  • velocity
  • file systems
  • database systems
  • service-oriented architecture

Fingerprint

Dive into the research topics of 'Data Interface All-iN-A-Place (DIANA) for Big Data'. Together they form a unique fingerprint.

Cite this