Click for new scientific resources and news about Corona[COVID-19]

Paper Information

Journal:   JOURNAL OF MODELING IN ENGINEERING   Winter 2019 , Volume 16 , Number 55 ; Page(s) 133 To 154.
 
Paper: 

Data Tarn: A New Approach For Management And Real-Time Analyses Of Big Data

 
 
Author(s):  Keshvari Saman*, Naderi Hassan, Ghayoori Sales Majid
 
* 
 
Abstract: 
By increasing the speed of data generation, need to process, store and analyze of Big Data becomes increasing. Related work has been done to create real-time data warehouse, but according to current unstructured data in Big Data, data warehouse with the old structure, it doesn't answer new management requirements of this type of Data. Recently, Data Lake has been proposed for unstructured data (with BASE properties). However, existence of important structured data (with ACID properties) and less sensitive unstructured big data on the other hand, causing new problems in the management of Big Data by using of this methods. In this paper we will offer a solution which is able to store structured data and unstructured data simultaneously and it can response to user’ s queries in real-time. As one of the important results of this research, after comparing the data warehouse and Data Lake concluded that the lake is not a replacement for a data warehouse, and data warehouse has particular use, especially in financial data; because the data warehouse compliance ACID theory, and Data Lake cater requirements of BASE theory. The raised idea in this paper has three main advantage: 1-Simultaneous use of data warehouse and Data Lake to meet the needs of the organization data with the benefits of them. 2-Separating new data from old data to achieve real-time. 3-Development parallelism, thus synchronization loading data and query processing to reduce the cost of time.
 
Keyword(s): Big Data,NoSQL Databases,Data Lake,Real-Time,Data Tarn
 
 
International related papers: 
  • No item.
 
Most related Highly related Moderately related Least related
 
References: 
  • Not Registered.
  •  
  •  
 
Citations: 
  • Not Registered.
 
+ Click to Cite.
APA: Copy

KESHVARI, s., & Naderi, H., & GHAYOORI SALES, M. (2019). Data Tarn: A New Approach for Management and Real-Time Analyses of Big Data. JOURNAL OF MODELING IN ENGINEERING, 16(55 ), 133-154. https://www.sid.ir/en/journal/ViewPaper.aspx?id=759114



Vancouver: Copy

KESHVARI saman, Naderi Hassan, GHAYOORI SALES MAJID. Data Tarn: A New Approach for Management and Real-Time Analyses of Big Data. JOURNAL OF MODELING IN ENGINEERING. 2019 [cited 2022January23];16(55 ):133-154. Available from: https://www.sid.ir/en/journal/ViewPaper.aspx?id=759114



IEEE: Copy

KESHVARI, s., Naderi, H., GHAYOORI SALES, M., 2019. Data Tarn: A New Approach for Management and Real-Time Analyses of Big Data. JOURNAL OF MODELING IN ENGINEERING, [online] 16(55 ), pp.133-154. Available: https://www.sid.ir/en/journal/ViewPaper.aspx?id=759114.



 
 
Persian Abstract Yearly Visit 43
 
 
Latest on Blog
Enter SID Blog