Category: MLOps
-
Modern frontier models such as the DeepSeek-V4 or GLM-5 series often contain hundreds of billions of parameters whose model weights alone require terabytes of memory and storage. Such models simply cannot fit within a single GPU or NPU regardless of its specifications. Training and serving LLMs at this scale requires…
+
+
+
+
+
+
+ Ascend NPU, CANN, Deep learning, Kubernetes, MindSpore, MLOps, Model training and evaluation, Python+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
I purchased a NucBox K11 Mini PC for my AI homelab in June 2026. Setting up JupyterHub on K3s allowed me to spin up pre-configured notebook environments in a single click. Unfortunately, until August, I couldn’t get my hands on the OrangePi AI Studio Pro extension dock. The dock finally…
+
+
+
+
+
+
+ Ascend NPU, CANN, Deep learning, Edge, Git, GitOps, Jupyter, Kubernetes, MindSpore, MLOps, Model training and evaluation, Python+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
The source code for the experiment mentioned in this article is available on GitHub. I was studying chapter 9 of D2L recently on natural language processing (NLP) using recurrent neural networks (RNN). To validate and further reinforce my understanding of the concepts presented in the chapter, I decided to train a word-level language…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
The source code for this article is available on GitHub. I recently purchased the GMKtec NucBox K11 Mini PC for building my AI homelab and support my ongoing journey on MLOps and deep learning. This blog post explains my motivations for building my AI homelab, the difficulties I encountered along the way, the design decisions I…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
The source code for this article is available on: GitHub, GitCode. Kubeflow transforms Kubernetes into a self-service platform for AI practitioners and data scientists alike. It incorporates both established and emerging cloud and AI-native projects such as Istio, Envoy and Knative to support the entire MLOps lifecycle: data cleaning and preprocessing, model training, validation and serving etc. Originally developed by Google to…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
-
+
+
+
+
+
+
The notebook source code for this experiment is available on GitHub. “MLflow is the largest open source AI engineering platform for agents, LLMs, and ML models.” It was originally developed by Databricks and joined the Linux Foundation in June 2020. MLflow enables data scientists and ML engineers to manage and visualize their model training pipelines…
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+