Daily Times

Huawei’s OceanStor A310 addresses critical industry challenges and expands the horizons of AI as it provides optimal storage capability for basic model training, industry model training, and inference in segmented scenario models, unleashing new AI capabilities.

The launch demonstrates Huawei’s alignment with the latest trends of AI development in the era of large models. The OceanStor A310 deep learning data lake storage caters to different industries and scenarios in large AI model applications mitigating the most significant challenges enterprises face in the development and implementation of large model applications.

Currently, pre-processing about a hundred terabytes of data takes around ten days as data preparation takes a long time, with dispersed data sources and slow aggregation. Moreover, for multi-modal large models using massive text and images as training sets, the current loading speed for a large number of small files is less than 100MB/s, resulting in low efficiency in loading training sets. Further delays occur because of the frequent tuning of large model parameters and instability in the training platform leading to training interruptions and recovery processes.

The high threshold for large model implementation, complex system construction, difficult resource scheduling, and GPU resource utilization is usually below 40%.

Meanwhile, the Huawei OceanStor A310’s deep learning data lake storage caters to different industries and scenarios in large model applications.

In the context of basic/industry large model scenarios, OceanStor A310 is a deep learning data lake storage solution that offers unlimited horizontal scalability and high performance for mixed workloads.