Skip to content
This repository was archived by the owner on May 28, 2026. It is now read-only.

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

BigDataWithSpark

This very simple Big Data with Apache Spark.

What Do this Code?

This code finds the name of the country from the domain up and counts how many IPs each country has.

This Code for

first you need download bin file ip2location.
second if you need add more data in ip range.
third you need fix all path files.

for download bin file see this link.

For run scala :

sbt compile sbt run

Note: you can add your master server for clustering(in python code we do this).

For python:

pip install -r req.txt py main.py

And output can be like This (you can see export file in folder out and out.cvs):

+---+-----+
|col|count|
+---+-----+
| SX|   60|
| NF|   60|
| MS|   60|
| NU|   60|
| TK|   60|
+---+-----+

About

This very simple Bigdata with Apache Spark.

Resources

Stars

Watchers

Forks

Releases

Packages

Contributors

Languages