Network data analysis using spark

KV Swetha, S Sathyadevan, P Bilna - … ), Vol 3: Software Engineering in …, 2015 - Springer
… Analysing the network data features provide a means for … analysis of network data using
Spark streaming technology which focuses on real time stream processing, built on top of Spark. …

Network intrusion detection in big dataset using spark

P Dahiya, DK Srivastava - Procedia computer science, 2018 - Elsevier
… It is clear from table 2 that when we used dataset-1 using spark then the Accuracy of Random
… (93.08%) algorithms was equally high so both were the winners in Accuracy using spark. …

Mobile big data analytics using deep learning and apache spark

MA Alsheikh, D Niyato, S Lin, HP Tan, Z Han - IEEE network, 2016 - ieeexplore.ieee.org
… Then we propose a Spark-based framework for learning deep models for time-efficient MBD
analytics within large-scale mobile systems. We present experimental analysis using a real-…

Performance analysis of network intrusion detection schemes using Apache Spark

M Kulariya, P Saraf, R Ranjan… - … on Communication and …, 2016 - ieeexplore.ieee.org
… to process large size of network traffic data as quickly as possible in … used Apache Spark,
a big data processing tool for detecting and analysis of intrusion in the communication network

Real-time data analysis using Spark and Hadoop

K Aziz, D Zaidouni, M Bellafkih - 2018 4th international …, 2018 - ieeexplore.ieee.org
… For example, the social network Twitter generated in January 2013, 7 terabytes of … article
we used Apache Spark for analysis Twitter data. As obtained in our experimental setup, Spark

Spark versus flink: Understanding performance in big data analytics frameworks

OC Marcu, A Costan, G Antoniu… - 2016 IEEE …, 2016 - ieeexplore.ieee.org
… In particular, we focus on Spark and Flink as representative data analytics frameworks… Spark
lies in the mandatory settings for the network buffers, used to store records or incoming data

[BOOK][B] Learning spark: lightning-fast big data analysis

H Karau, A Konwinski, P Wendell, M Zaharia - 2015 - books.google.com
… Recently updated for Spark 1.3, this book introduces Apache Spark, the open source … data
analytics fast to write and fast to run. With Spark, you can tackle big datasets quickly through

Social media data processing infrastructure by using Apache spark big data platform: Twitter data analysis

M Podhoranyi, L Vojacek - Proceedings of the 2019 4th International …, 2019 - dl.acm.org
… The main goal of this work is to propose architecture and workflow able to process social
network data in near real-time. The primary purpose of the introduced modern architecture …

A big data analysis framework using apache spark and deep learning

A Gupta, HK Thakur, R Shrivastava… - … conference on data …, 2017 - ieeexplore.ieee.org
using the internally defined library of Spark, or the MLP can be generated by creating the
Artificial Neural Network … -propagation network to continuously train the network and reduce the …

Big data analytics with datalog queries on spark

A Shkapsky, M Yang, M Interlandi, H Chiu… - … Management of Data, 2016 - dl.acm.org
Spark. We introduce recursion operators and data structures to efficiently implement the
technique in Spark… Nodes of the cluster are connected with 1Gbit network. Our implementation is …