Category: Deep learning
-
Modern frontier models such as the DeepSeek-V4 or GLM-5 series often contain hundreds of billions of parameters whose model weights alone require terabytes of memory and storage. Such models simply cannot fit within a single GPU or NPU regardless of its specifications. Training and serving LLMs at this scale requires…
+
+
+
+
+
+
+ Ascend NPU, CANN, Deep learning, Kubernetes, MindSpore, MLOps, Model training and evaluation, Python+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
I purchased a NucBox K11 Mini PC for my AI homelab in June 2026. Setting up JupyterHub on K3s allowed me to spin up pre-configured notebook environments in a single click. Unfortunately, until August, I couldn’t get my hands on the OrangePi AI Studio Pro extension dock. The dock finally…
+
+
+
+
+
+
+ Ascend NPU, CANN, Deep learning, Edge, Git, GitOps, Jupyter, Kubernetes, MindSpore, MLOps, Model training and evaluation, Python+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
The source code for the experiment mentioned in this article is available on GitHub. I was studying chapter 9 of D2L recently on natural language processing (NLP) using recurrent neural networks (RNN). To validate and further reinforce my understanding of the concepts presented in the chapter, I decided to train a word-level language…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
The source code for this article is available on GitHub. I recently purchased the GMKtec NucBox K11 Mini PC for building my AI homelab and support my ongoing journey on MLOps and deep learning. This blog post explains my motivations for building my AI homelab, the difficulties I encountered along the way, the design decisions I…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
The source code for this article is available on: GitHub, GitCode. Kubeflow transforms Kubernetes into a self-service platform for AI practitioners and data scientists alike. It incorporates both established and emerging cloud and AI-native projects such as Istio, Envoy and Knative to support the entire MLOps lifecycle: data cleaning and preprocessing, model training, validation and serving etc. Originally developed by Google to…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
The notebook source code for this experiment is available on GitHub. “MLflow is the largest open source AI engineering platform for agents, LLMs, and ML models.” It was originally developed by Databricks and joined the Linux Foundation in June 2020. MLflow enables data scientists and ML engineers to manage and visualize their model training pipelines…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
The notebook source code for this article is available on GitHub. Transfer learning is the practice of adapting a pre-trained model for a new but related task. An example of transfer learning is low-rank adaptation (LoRA), a common technique in LLM fine-tuning. In this notebook experiment, let’s load ResNet-18 with MindCV for fine-tuning on the CIFAR-100 dataset. ResNet-18 is…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
The notebook source code for this article is available on GitHub. PyTorch is an open source deep learning framework in Python originally developed by Meta, now hosted under the vendor-neutral PyTorch Foundation. It is the de-facto industry standard for training modern deep learning models and large language models (LLMs). Like most other deep learning…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
The notebook source code for this article is available on: GitCode, GitHub MindSpore is an open source deep learning framework lead by Huawei and the MindSpore community. It is optimized for performing model training and inference tasks on Huawei’s Ascend series processors (NPUs), though it supports NVIDIA GPUs and CPU-only environments as well. It provides a compelling…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+