Course Outline
Introduction to the Stratio Platform
- An overview of Stratio’s architecture and its core components
- The specific roles of Rocket and Intelligence within the broader data lifecycle
- Accessing the platform and navigating the Stratio user interface
Utilizing the Rocket Module
- Strategies for data ingestion and constructing efficient pipelines
- Establishing connections to data sources and configuring effective transformations
- Leveraging PySpark to handle preprocessing tasks within Rocket
PySpark Fundamentals for Stratio Users
- Essential PySpark data structures and their associated operations
- Applying looping constructs, including for, while, and if/else statements
- Developing and applying custom functions using the def keyword
Advanced Integration of Rocket and PySpark
- Implementing streaming ingestion and real-time transformations
- Incorporating loops and functions in both batch processing and real-time scenarios
- Adopting best practices to optimize performance in PySpark pipelines
Delving into the Intelligence Module
- An overview of data modeling and analytical capabilities
- Techniques for feature selection, transformation, and data exploration
- The role of PySpark in driving custom analytics and generating insights
Constructing Advanced Analytics Workflows
- Developing user-defined functions (UDFs) specifically within the Intelligence module
- Utilizing conditionals and loops to manage complex data logic
- Practical use cases, including segmentation, aggregation, and predictive modeling
Deployment and Team Collaboration
- Techniques for saving, exporting, and reusing established workflows
- Strategies for effective collaboration with team members on the Stratio platform
- Reviewing outputs and integrating results with downstream tools
Conclusion and Future Steps
Requirements
- Proficiency in Python programming
- A solid grasp of data analytics or big data processing principles
- Foundational knowledge of Apache Spark and distributed computing concepts
Target Audience
- Data engineers operating within Stratio-based platforms
- Analysts or developers who frequently utilize the Rocket and Intelligence modules
- Technical teams in the process of adopting PySpark workflows within the Stratio environment
Testimonials (3)
Learning that the QGIS and a tool that can used by other different professionals such land survey
Bame Duncan Koko - Bentel Technologies (Pty) Ltd
Course - QGIS for Geographic Information System
How to use open satellites data for real applications
Tshering Dorji - Druk Holding and Investments
Course - Advanced Geographic Information Systems (GIS)
Hands-on examples allowed us to get an actual feel for how the program works. Good explanations and integration of theoretical concepts and how they relate to practical applications.