🔌 Raspberry Pi 5 + AI HAT+ 2 · ราสเบอร์รี่ พาย 5 กับ AI HAT+ 2 · 树莓派 5 加 AI HAT+ 2

1 Why Trixie, and why nothing else · ทำไมต้อง Trixie และทำไมไม่ใช่อย่างอื่น · 为什么是 Trixie，为什么别的都不行

2 Flash the card · แฟลชการ์ด · 把卡烧好

📘 FROM THE DOCS · quoted, not run here

# Find the Pi once it is up. The name is what you set in the Imager.
ssh pi@raspberrypi.local

# Bring everything up to date before you add the HAT software.
sudo apt update
sudo apt full-upgrade -y

# The bootloader lives in its own chip and updates separately.
sudo rpi-eeprom-update -a
sudo reboot

3 Firmware first, then one package · เฟิร์มแวร์ก่อน แล้วค่อยแพ็กเกจเดียว · 先固件，再一个包

📘 FROM THE DOCS · quoted, not run here

# dkms rebuilds the kernel module whenever the kernel updates. Install it first.
sudo apt install dkms

# The one that matters. h10 means Hailo-10H, which is the AI HAT+ 2.
# hailo-all is the Hailo-8 package. The two cannot be installed together.
sudo apt install hailo-h10-all

sudo reboot

4 Prove the chip is really there · พิสูจน์ว่าชิปอยู่ตรงนั้นจริง · 证明芯片真的在

📘 FROM THE DOCS · quoted, not run here

# 1. Is it on the PCIe bus at all? If this is empty, it is a hardware problem.
lspci | grep -i hailo

# 2. Did the kernel pick it up? Look for the driver loading, and for errors.
dmesg | grep -i hailo

# 3. Can the runtime talk to the firmware? This is the real test.
hailortcli fw-control identify

5 A script that checks before you install · สคริปต์ที่ตรวจให้ก่อนติดตั้ง · 一个装之前先帮你检查的脚本

📄 NEW FILE · hailo_preflight.sh

#!/usr/bin/env bash
# hailo_preflight.sh - read-only checks before installing the Gen AI model zoo.
# Changes nothing. Run it on the Pi 5, fix every FAIL, then install by hand.
#
#   scp hailo_preflight.sh pi@raspberrypi.local:~
#   ssh pi@raspberrypi.local 'bash hailo_preflight.sh'

pass=0; fail=0
ok()   { printf '  \033[32mOK  \033[0m %s\n' "$1"; pass=$((pass+1)); }
bad()  { printf '  \033[31mFAIL\033[0m %s\n' "$1"; fail=$((fail+1)); }
note() { printf '       %s\n' "$1"; }
head_() { printf '\n== %s ==\n' "$1"; }

head_ "1. Board"
# Guard the read. "< file 2>/dev/null" does not silence a missing file: the
# shell fails to open it before tr ever runs, and prints its own error.
model=""
[ -r /proc/device-tree/model ] && model=$(tr -d '\0' < /proc/device-tree/model)
case "$model" in
  *"Raspberry Pi 5"*) ok "$model" ;;
  *) bad "need a Raspberry Pi 5, found: ${model:-unknown}" ;;
esac

head_ "2. Architecture - 64-bit is mandatory"
arch=$(uname -m)
[ "$arch" = "aarch64" ] && ok "arch $arch" || bad "arch $arch, need aarch64"

head_ "3. OS - must be Trixie / Debian 13"
codename=$(. /etc/os-release 2>/dev/null; echo "$VERSION_CODENAME")
pretty=$(. /etc/os-release 2>/dev/null; echo "$PRETTY_NAME")
if [ "$codename" = "trixie" ]; then
  ok "$pretty"
else
  bad "$pretty - hailo-h10-all needs Trixie"
  note "Pi OS major upgrades are not supported in place. Plan a clean flash."
fi

head_ "4. Kernel - 6.12 or newer"
kver=$(uname -r)
kmaj=$(echo "$kver" | cut -d. -f1); kmin=$(echo "$kver" | cut -d. -f2)
if [ "$kmaj" -gt 6 ] 2>/dev/null || { [ "$kmaj" -eq 6 ] && [ "$kmin" -ge 12 ]; } 2>/dev/null; then
  ok "kernel $kver"
else
  bad "kernel $kver, need 6.12+"
fi

head_ "5. Is the HAT on the PCIe bus?"
if command -v lspci > /dev/null 2>&1; then
  hailo_pci=$(lspci 2>/dev/null | grep -i hailo)
  if [ -n "$hailo_pci" ]; then
    ok "$hailo_pci"
    case "$hailo_pci" in
      *"Hailo-10"*|*1888:0010*) note "Hailo-10H - the AI HAT+ 2, use hailo-h10-all" ;;
      *) note "NOT a Hailo-10H. hailo-h10-all is the wrong package." ;;
    esac
  else
    bad "no Hailo device on the PCIe bus"
    note "Power off fully, reseat the ribbon cable, check its orientation."
  fi
else
  bad "lspci missing - sudo apt install pciutils"
fi

head_ "6. Conflicting driver package"
# hailo-all (Hailo-8/8L) and hailo-h10-all (Hailo-10H) cannot coexist.
if dpkg -l 2>/dev/null | grep -q '^ii  hailo-all'; then
  bad "hailo-all is installed - it conflicts with hailo-h10-all"
  note "sudo apt remove --purge hailo-all   (then reboot)"
else
  ok "hailo-all not installed"
fi

head_ "7. Driver stack"
if dpkg -l 2>/dev/null | grep -q '^ii  hailo-h10-all'; then
  ok "hailo-h10-all installed"
else
  bad "hailo-h10-all not installed yet"
fi
if lsmod 2>/dev/null | grep -q hailo; then
  ok "kernel module loaded"
else
  bad "no hailo kernel module loaded"
fi

head_ "8. Runtime talks to the chip"
if command -v hailortcli > /dev/null 2>&1; then
  if hailortcli fw-control identify > /tmp/hailo_id.txt 2>&1; then
    ok "hailortcli reached the device"
    sed 's/^/       /' /tmp/hailo_id.txt | head -8
  else
    bad "hailortcli could not reach the device"
  fi
else
  bad "hailortcli not found (comes with hailo-h10-all)"
fi

head_ "9. Room for the model zoo"
avail=$(df -BG --output=avail / 2>/dev/null | tail -1 | tr -d ' G')
if [ -n "$avail" ] && [ "$avail" -ge 16 ] 2>/dev/null; then
  ok "${avail}G free on /"
else
  bad "only ${avail:-?}G free on / - want 16G+"
fi

head_ "10. Is port 8000 already taken?"
if command -v ss > /dev/null 2>&1 && ss -ltn 2>/dev/null | grep -q ':8000 '; then
  bad "something is already listening on :8000"
  note "hailo-ollama binds 8000. Stop the other service or move it."
else
  ok "port 8000 free"
fi

printf '\n== %d passed, %d failed ==\n' "$pass" "$fail"
[ "$fail" -eq 0 ] && printf 'Ready for the model zoo.\n' \
                 || printf 'Fix the FAILs above first.\n'
exit 0

✅ ACTUALLY RUN · the script above, on aarch64 Linux with no Pi and no HAT, 27 September 2026

== 1. Board ==
  FAIL need a Raspberry Pi 5, found: unknown

== 2. Architecture - 64-bit is mandatory ==
  OK   arch aarch64

== 3. OS - must be Trixie / Debian 13 ==
  FAIL Ubuntu 24.04.4 LTS - hailo-h10-all needs Trixie
       Pi OS major upgrades are not supported in place. Plan a clean flash.

== 4. Kernel - 6.12 or newer ==
  OK   kernel 6.17.0-1018-nvidia

== 5. Is the HAT on the PCIe bus? ==
  FAIL no Hailo device on the PCIe bus
       Power off fully, reseat the ribbon cable, check its orientation.

== 6. Conflicting driver package ==
  OK   hailo-all not installed

== 7. Driver stack ==
  FAIL hailo-h10-all not installed yet
  FAIL no hailo kernel module loaded

== 8. Runtime talks to the chip ==
  FAIL hailortcli not found (comes with hailo-h10-all)

== 9. Room for the model zoo ==
  OK   3269G free on /

== 10. Is port 8000 already taken? ==
  OK   port 8000 free

== 5 passed, 6 failed ==
Fix the FAILs above first.

6 The model zoo package · แพ็กเกจสวนสัตว์โมเดล · 模型园那个包

📘 FROM THE DOCS · quoted, not run here

# A direct download, not an apt repository. Nothing will update this for you.
wget https://dev-public.hailo.ai/2025_12/Hailo10/hailo_gen_ai_model_zoo_5.1.1_arm64.deb

sudo dpkg -i hailo_gen_ai_model_zoo_5.1.1_arm64.deb

# dpkg does not fetch dependencies. If it complained, this finishes the job.
sudo apt -f install

7 List, pull, ask · ดูรายการ ดึงมา แล้วถาม · 列出、拉取、提问

📘 FROM THE DOCS · quoted, not run here

# Starts in the foreground and binds port 8000. It holds this terminal.
hailo-ollama

# --- everything below goes in a SECOND terminal ---

# Which models will actually run on this chip. Trust this over any web page.
curl --silent http://localhost:8000/hailo/v1/list

# Fetch one. stream:true prints progress instead of waiting in silence.
curl --silent http://localhost:8000/api/pull \
     -H 'Content-Type: application/json' \
     -d '{ "model": "qwen2:1.5b", "stream": true }'

# Ask it something. Same shape as the Ollama chat API.
curl --silent http://localhost:8000/api/chat \
     -H 'Content-Type: application/json' \
     -d '{"model": "qwen2:1.5b", "messages": [{"role": "user", "content": "Hello"}]}'

8 Keep it running after you log out · ให้มันทำงานต่อหลังคุณออกจากระบบ · 你退出登录后让它继续跑

🛠️ NOT FROM THE DOCS · the ordinary systemd pattern, adjust User=

# /etc/systemd/system/hailo-ollama.service
[Unit]
Description=Hailo Ollama server
After=network-online.target
Wants=network-online.target

[Service]
ExecStart=/usr/bin/hailo-ollama
User=pi
Restart=on-failure
RestartSec=5

[Install]
WantedBy=multi-user.target

🛠️ NOT FROM THE DOCS · turning it on

# daemon-reload tells systemd to read the new file. It will not find it alone.
sudo systemctl daemon-reload

# enable means start at boot. --now also starts it this second.
sudo systemctl enable --now hailo-ollama

systemctl status hailo-ollama
journalctl -u hailo-ollama -f

9 Read these before you buy · อ่านพวกนี้ก่อนจ่ายเงิน · 掏钱之前先读这些

10 Try first. The answers are folded away. · ลองเองก่อน เฉลยพับซ่อนไว้ · 先自己试。答案折起来放着。

# An ssh tunnel. -L means: port 8000 on my laptop becomes port 8000 on the Pi.
# Nothing on the Pi changes, and nothing new is exposed to the network.
ssh -N -L 8000:localhost:8000 pi@raspberrypi.local

# Then on the laptop, in another terminal, it looks local:
curl --silent http://localhost:8000/hailo/v1/list

# The API shape matches, so only the address changes. Two ports differ:
#   ollama on a normal box : 11434
#   hailo-ollama on the Pi :  8000

# Most tools read one of these. Set it and nothing else.
export OLLAMA_HOST=http://raspberrypi.local:8000

# Open WebUI in Docker takes it as an environment variable too.
docker run -d \
  -e OLLAMA_BASE_URL=http://127.0.0.1:8000 \
  -v open-webui:/app/backend/data \
  --name open-webui --network=host --restart always \
  ghcr.io/open-webui/open-webui:main

# watch -n 2 repeats a command every two seconds and redraws the screen.
# throttled=0x0 means nothing has been slowed down. Anything else is a warning.
watch -n 2 'vcgencmd measure_temp; vcgencmd get_throttled'

# Leave that running, then send a long prompt from another terminal and watch.

# Add this before the final printf in hailo_preflight.sh.
head_ "11. Gen AI model zoo"
if command -v hailo-ollama > /dev/null 2>&1; then
  ok "hailo-ollama found at $(command -v hailo-ollama)"
  note "use that path in the systemd unit"
else
  bad "hailo-ollama not installed"
  note "that is expected before you install the model zoo"
fi