Thank you for sending your enquiry! One of our team members will contact you shortly.
Thank you for sending your booking! One of our team members will contact you shortly.
Course Outline
Introduction to Edge AI and Ascend 310
- Overview of Edge AI: exploring trends, constraints, and key applications.
- Examination of the Huawei Ascend 310 chip architecture and its supported toolchain.
- Understanding the role of CANN within the edge AI deployment ecosystem.
Model Preparation and Conversion
- Exporting trained models from TensorFlow, PyTorch, and MindSpore.
- Utilizing ATC to transform models into OM format for Ascend devices.
- Addressing unsupported operations and applying lightweight conversion strategies.
Developing Inference Pipelines with AscendCL
- Leveraging the AscendCL API to execute OM models on Ascend 310 hardware.
- Managing input/output preprocessing, memory allocation, and device control.
- Integrating models within embedded containers or lightweight runtime environments.
Optimization for Edge Constraints
- Reducing model footprint and adjusting precision (FP16, INT8).
- Identifying performance bottlenecks using the CANN profiler.
- Optimizing memory layout and data streaming to enhance performance.
Deploying with MindSpore Lite
- Utilizing the MindSpore Lite runtime for mobile and embedded platforms.
- Comparing the MindSpore Lite approach against raw AscendCL pipelines.
- Packaging inference models for specific device deployments.
Edge Deployment Scenarios and Case Studies
- Case study: Implementing an object detection model on a smart camera using Ascend 310.
- Case study: Achieving real-time classification in an IoT sensor hub.
- Techniques for monitoring and updating models deployed at the edge.
Summary and Next Steps
Requirements
- Hands-on experience with AI model development or deployment workflows.
- Foundational knowledge of embedded systems, Linux, and Python.
- Familiarity with deep learning frameworks such as TensorFlow or PyTorch.
Target Audience
- IoT solution developers.
- Embedded AI engineers.
- Edge system integrators and AI deployment specialists.
14 Hours
Testimonials (1)
That we can cover advance topic and work with real-life example