Category: Python
-
Modern frontier models such as the DeepSeek-V4 or GLM-5 series often contain hundreds of billions of parameters whose model weights alone require terabytes of memory and storage. Such models simply cannot fit within a single GPU or NPU regardless of its specifications. Training and serving LLMs at this scale requires…
+
+
+
+
+
+
+ Ascend NPU, CANN, Deep learning, Kubernetes, MindSpore, MLOps, Model training and evaluation, Python+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
I purchased a NucBox K11 Mini PC for my AI homelab in June 2026. Setting up JupyterHub on K3s allowed me to spin up pre-configured notebook environments in a single click. Unfortunately, until August, I couldn’t get my hands on the OrangePi AI Studio Pro extension dock. The dock finally…
+
+
+
+
+
+
+ Ascend NPU, CANN, Deep learning, Edge, Git, GitOps, Jupyter, Kubernetes, MindSpore, MLOps, Model training and evaluation, Python+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
The source code for the experiment mentioned in this article is available on GitHub. I was studying chapter 9 of D2L recently on natural language processing (NLP) using recurrent neural networks (RNN). To validate and further reinforce my understanding of the concepts presented in the chapter, I decided to train a word-level language…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
The source code for this article is available on GitHub. I recently purchased the GMKtec NucBox K11 Mini PC for building my AI homelab and support my ongoing journey on MLOps and deep learning. This blog post explains my motivations for building my AI homelab, the difficulties I encountered along the way, the design decisions I…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
The source code for this article is available on: GitHub, GitCode. Kubeflow transforms Kubernetes into a self-service platform for AI practitioners and data scientists alike. It incorporates both established and emerging cloud and AI-native projects such as Istio, Envoy and Knative to support the entire MLOps lifecycle: data cleaning and preprocessing, model training, validation and serving etc. Originally developed by Google to…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
The notebook source code for this experiment is available on GitHub. “MLflow is the largest open source AI engineering platform for agents, LLMs, and ML models.” It was originally developed by Databricks and joined the Linux Foundation in June 2020. MLflow enables data scientists and ML engineers to manage and visualize their model training pipelines…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
The notebook source code for this article is available on GitHub. Transfer learning is the practice of adapting a pre-trained model for a new but related task. An example of transfer learning is low-rank adaptation (LoRA), a common technique in LLM fine-tuning. In this notebook experiment, let’s load ResNet-18 with MindCV for fine-tuning on the CIFAR-100 dataset. ResNet-18 is…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
The notebook source code for this article is available on GitHub. Last time we saw how to upgrade the MindSpore 2.4.10 + CANN 8.0.0 pre-included with the Ubuntu 22.04 desktop image for OrangePi AIpro (20T) to MindSpore 2.8.0 + CANN 8.5.0. MindSpore 2.9.0 + CANN 9.0.0 were released on May 2026 with the following major highlights, among others. This…
-
The notebook source code for this article is available on GitHub. PyTorch is an open source deep learning framework in Python originally developed by Meta, now hosted under the vendor-neutral PyTorch Foundation. It is the de-facto industry standard for training modern deep learning models and large language models (LLMs). Like most other deep learning…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
This Kaggle Notebook is a GPU-enabled variation of my original notebook experiment. Open Neural Network Exchange (ONNX) is an open format built to represent machine learning models. It is used by popular deep learning frameworks such as MindSpore, PyTorch and TensorFlow to export machine learning models trained by these frameworks into the portable, unified and vendor-neutral ONNX format. This…