Get in Touch
 Duration 14 hours

Course Outline

Introduction to Edge AI and Ascend 310

  • Overview of Edge AI: current trends, constraints, and key applications
  • Architecture of the Huawei Ascend 310 chip and its supported toolchain
  • The role of CANN within the edge AI deployment stack

Model Preparation and Conversion

  • Exporting trained models from TensorFlow, PyTorch, and MindSpore
  • Utilizing ATC to convert models to OM format for Ascend devices
  • Managing unsupported operations and implementing lightweight conversion strategies

Developing Inference Pipelines with AscendCL

  • Executing OM models on Ascend 310 using the AscendCL API
  • Input/output preprocessing, memory management, and device control
  • Deploying applications within embedded containers or lightweight runtime environments

Optimization for Edge Constraints

  • Reducing model size and tuning precision (FP16, INT8)
  • Identifying performance bottlenecks using the CANN profiler
  • Managing memory layout and data streaming to enhance performance

Deploying with MindSpore Lite

  • Utilizing the MindSpore Lite runtime for mobile and embedded targets
  • Comparing MindSpore Lite with raw AscendCL pipelines
  • Packaging inference models for device-specific deployment

Edge Deployment Scenarios and Case Studies

  • Case study: Implementing a smart camera with an object detection model on Ascend 310
  • Case study: Real-time classification within an IoT sensor hub
  • Monitoring and updating deployed models at the edge

Summary and Next Steps

Requirements

  • Prior experience with AI model development or deployment workflows
  • Foundational knowledge of embedded systems, Linux, and Python
  • Familiarity with deep learning frameworks such as TensorFlow or PyTorch

Target Audience

  • IoT solution developers
  • Embedded AI engineers
  • Edge system integrators and AI deployment specialists

Testimonials (1)

Upcoming Courses

Related Categories