10 Commits

Author SHA1 Message Date
user
da9859571b ci: Remove shellcheck, run deploy in container with host network
Some checks failed
Lint & Build / Security Flaw Analysis (push) Successful in 16s
Lint & Build / Secret Scanning (push) Successful in 4s
Lint & Build / C/C++ Static Analysis (push) Successful in 27s
Lint & Build / Build Firmware (push) Successful in 2m41s
Lint & Build / Deploy to ESP Fleet (push) Has been cancelled
- Remove shellcheck job (no shell scripts)
- Deploy job now uses espressif/idf container with --network=host
- Install git, curl, jq, netcat in deploy container
2026-02-05 22:54:16 +01:00
user
52603fb097 fix: Use git clone instead of curl for deploy checkout
Some checks failed
Lint & Build / Security Flaw Analysis (push) Successful in 15s
Lint & Build / Secret Scanning (push) Successful in 5s
Lint & Build / C/C++ Static Analysis (push) Successful in 28s
Lint & Build / Shell Script Analysis (push) Successful in 7s
Lint & Build / Build Firmware (push) Successful in 2m52s
Lint & Build / Deploy to ESP Fleet (push) Failing after 0s
2026-02-05 22:47:51 +01:00
user
974ffadb1c ci: Add firmware size check and version tag validation
Some checks failed
Lint & Build / Security Flaw Analysis (push) Successful in 15s
Lint & Build / Secret Scanning (push) Successful in 5s
Lint & Build / C/C++ Static Analysis (push) Successful in 28s
Lint & Build / Shell Script Analysis (push) Successful in 7s
Lint & Build / Build Firmware (push) Successful in 1m51s
Lint & Build / Deploy to ESP Fleet (push) Failing after 1s
- Fail build if binary exceeds 1920 KB partition
- Warn at 85% capacity
- Warn if git tag differs from embedded version
2026-02-05 22:42:49 +01:00
user
eb4c3d1657 feat: Add build metadata to STATUS, enable size optimization
STATUS now includes built=, idf=, chip= fields for diagnostics.
Switch to -Os compiler optimization (saves ~75 KB).
2026-02-05 22:42:45 +01:00
user
456b4f0b9a ci: Run build after checks pass, fix deploy checkout
All checks were successful
Lint & Build / Security Flaw Analysis (push) Successful in 15s
Lint & Build / Secret Scanning (push) Successful in 5s
Lint & Build / C/C++ Static Analysis (push) Successful in 27s
Lint & Build / Shell Script Analysis (push) Successful in 7s
Lint & Build / Build Firmware (push) Successful in 1m53s
Lint & Build / Deploy to ESP Fleet (push) Has been skipped
2026-02-05 22:24:38 +01:00
user
a338c9f65f ci: Fix multiline command syntax for host runner
Some checks failed
Lint & Build / C/C++ Static Analysis (push) Successful in 29s
Lint & Build / Security Flaw Analysis (push) Successful in 20s
Lint & Build / Secret Scanning (push) Successful in 8s
Lint & Build / Shell Script Analysis (push) Successful in 9s
Lint & Build / Build Firmware (push) Successful in 2m4s
Lint & Build / Deploy to ESP Fleet (push) Failing after 1s
2026-02-05 22:18:50 +01:00
user
fbf2e9a7c1 ci: Add OTA progress monitoring with version checks
Some checks are pending
Lint & Build / C/C++ Static Analysis (push) Successful in 29s
Lint & Build / Deploy to ESP Fleet (push) Blocked by required conditions
Lint & Build / Security Flaw Analysis (push) Successful in 21s
Lint & Build / Secret Scanning (push) Successful in 8s
Lint & Build / Shell Script Analysis (push) Successful in 9s
Lint & Build / Build Firmware (push) Successful in 2m24s
2026-02-05 22:11:13 +01:00
user
1377abe248 ci: Run deploy on host instead of container for network access
Some checks failed
Lint & Build / Deploy to ESP Fleet (push) Has been cancelled
Lint & Build / Security Flaw Analysis (push) Has been cancelled
Lint & Build / Secret Scanning (push) Has been cancelled
Lint & Build / Shell Script Analysis (push) Has been cancelled
Lint & Build / C/C++ Static Analysis (push) Has been cancelled
Lint & Build / Build Firmware (push) Has been cancelled
2026-02-05 22:09:47 +01:00
user
551225d308 fix: Remove unused app_size variable (cppcheck)
All checks were successful
Lint & Build / C/C++ Static Analysis (push) Successful in 29s
Lint & Build / Security Flaw Analysis (push) Successful in 22s
Lint & Build / Secret Scanning (push) Successful in 8s
Lint & Build / Shell Script Analysis (push) Successful in 10s
Lint & Build / Build Firmware (push) Successful in 2m21s
Lint & Build / Deploy to ESP Fleet (push) Successful in 3m20s
2026-02-05 22:08:30 +01:00
user
7f2e3f6dad ci: Add ccache for faster builds + parallel OTA deployment
Some checks failed
Lint & Build / C/C++ Static Analysis (push) Failing after 32s
Lint & Build / Security Flaw Analysis (push) Successful in 21s
Lint & Build / Secret Scanning (push) Successful in 8s
Lint & Build / Shell Script Analysis (push) Successful in 10s
Lint & Build / Build Firmware (push) Successful in 2m7s
Lint & Build / Deploy to ESP Fleet (push) Successful in 3m0s
Build improvements:
- Enable ccache via IDF_CCACHE_ENABLE=1
- Mount /var/cache/ccache volume for persistent cache
- Show ccache stats after build

Deployment improvements:
- Deploy to all sensors in parallel (max 3)
- Reduced total deploy time from ~2.5min to ~1min

Note: Runner needs /var/cache/ccache directory with write permissions
2026-02-05 22:02:29 +01:00
3 changed files with 117 additions and 45 deletions

View File

@@ -20,25 +20,60 @@ on:
jobs: jobs:
build: build:
name: Build Firmware name: Build Firmware
needs: [cppcheck, flawfinder, gitleaks]
runs-on: anvil runs-on: anvil
container: container:
image: docker.io/espressif/idf:v5.3 image: docker.io/espressif/idf:v5.3
volumes:
- /var/cache/ccache:/ccache
env:
CCACHE_DIR: /ccache
IDF_CCACHE_ENABLE: 1
steps: steps:
- name: Checkout - name: Checkout
run: | run: |
git clone --depth=1 --branch=${{ github.ref_name }} \ git clone --depth=1 --branch=${{ github.ref_name }} \
https://oauth2:${{ github.token }}@git.mymx.me/${{ github.repository }}.git . https://oauth2:${{ github.token }}@git.mymx.me/${{ github.repository }}.git .
- name: Setup ccache
run: |
apt-get update && apt-get install -y --no-install-recommends ccache
ccache --zero-stats
ccache --show-config | grep -E "(cache_dir|max_size)"
- name: Build firmware - name: Build firmware
run: | run: |
. /opt/esp/idf/export.sh . /opt/esp/idf/export.sh
cd get-started/csi_recv_router cd get-started/csi_recv_router
idf.py build idf.py build
- name: Show ccache stats
run: ccache --show-stats
- name: Show binary size - name: Show binary size
run: | run: |
ls -lh get-started/csi_recv_router/build/*.bin ls -lh get-started/csi_recv_router/build/*.bin
- name: Check firmware size
run: |
BIN="get-started/csi_recv_router/build/csi_recv_router.bin"
MAX_SIZE=1966080 # 0x1E0000 = 1920 KB partition
WARN_PERCENT=85
SIZE=$(stat -c%s "$BIN")
PERCENT=$((SIZE * 100 / MAX_SIZE))
echo "Firmware: $((SIZE/1024)) KB / $((MAX_SIZE/1024)) KB ($PERCENT%)"
if [ $SIZE -gt $MAX_SIZE ]; then
echo "::error::Firmware exceeds partition size!"
exit 1
fi
if [ $PERCENT -gt $WARN_PERCENT ]; then
echo "::warning::Firmware using $PERCENT% of partition"
fi
- name: Upload firmware artifact - name: Upload firmware artifact
run: | run: |
mkdir -p /tmp/artifacts mkdir -p /tmp/artifacts
@@ -56,11 +91,10 @@ jobs:
if: github.event_name == 'workflow_dispatch' && github.event.inputs.deploy == 'true' || startsWith(github.ref, 'refs/tags/v') if: github.event_name == 'workflow_dispatch' && github.event.inputs.deploy == 'true' || startsWith(github.ref, 'refs/tags/v')
container: container:
image: docker.io/espressif/idf:v5.3 image: docker.io/espressif/idf:v5.3
options: --network host options: --network=host
steps: steps:
- name: Install tools - name: Install tools
run: | run: apt-get update && apt-get install -y --no-install-recommends git curl jq netcat-openbsd
apt-get update && apt-get install -y --no-install-recommends netcat-openbsd curl jq
- name: Checkout - name: Checkout
run: | run: |
@@ -73,6 +107,19 @@ jobs:
cd get-started/csi_recv_router cd get-started/csi_recv_router
idf.py build idf.py build
- name: Validate version tag
run: |
TAG="${{ github.ref_name }}"
# Extract version from binary metadata
BIN_VER=$(strings get-started/csi_recv_router/build/csi_recv_router.bin | grep -oP '^v\d+\.\d+(\.\d+)?' | head -1)
echo "Git tag: $TAG"
echo "Binary version: $BIN_VER"
if [ "$TAG" != "$BIN_VER" ]; then
echo "::warning::Tag ($TAG) differs from binary ($BIN_VER)"
fi
- name: Create release and upload firmware - name: Create release and upload firmware
env: env:
GITEA_TOKEN: ${{ github.token }} GITEA_TOKEN: ${{ github.token }}
@@ -110,8 +157,8 @@ jobs:
- name: Deploy via OTA - name: Deploy via OTA
run: | run: |
SENSORS="muddy-storm:192.168.129.29 amber-maple:192.168.129.30 hollow-acorn:192.168.129.31" SENSORS="muddy-storm:192.168.129.29 amber-maple:192.168.129.30 hollow-acorn:192.168.129.31"
FIRMWARE_PATH="get-started/csi_recv_router/build/csi_recv_router.bin"
OTA_PORT=8899 OTA_PORT=8899
EXPECTED_VERSION="${{ github.ref_name }}"
# Get runner IP (first non-loopback interface) # Get runner IP (first non-loopback interface)
RUNNER_IP=$(hostname -I | awk '{print $1}') RUNNER_IP=$(hostname -I | awk '{print $1}')
@@ -129,19 +176,65 @@ jobs:
# Verify server is running # Verify server is running
curl -sI "http://localhost:${OTA_PORT}/csi_recv_router.bin" | head -1 curl -sI "http://localhost:${OTA_PORT}/csi_recv_router.bin" | head -1
# Deploy to each sensor # Deploy to all sensors in parallel
echo "=== Deploying to all sensors in parallel ==="
for entry in $SENSORS; do for entry in $SENSORS; do
NAME="${entry%%:*}" NAME="${entry%%:*}"
IP="${entry##*:}" IP="${entry##*:}"
echo "=== Deploying to $NAME ($IP) ===" echo "OTA $FIRMWARE_URL" | nc -u -w 2 "$IP" 5501 &
echo "OTA $FIRMWARE_URL" | nc -u -w 2 "$IP" 5501 || true done
sleep 45 wait
# Monitor progress
echo "=== Monitoring OTA progress (timeout: 90s) ==="
TIMEOUT=90
INTERVAL=5
ELAPSED=0
while [ $ELAPSED -lt $TIMEOUT ]; do
sleep $INTERVAL
ELAPSED=$((ELAPSED + INTERVAL))
echo "--- Progress check at ${ELAPSED}s ---"
ALL_UPDATED=true
for entry in $SENSORS; do
NAME="${entry%%:*}"
IP="${entry##*:}"
# Query sensor version via UDP STATUS command
RESPONSE=$(echo "STATUS" | nc -u -w 1 "$IP" 5501 2>/dev/null || echo "")
VERSION=$(echo "$RESPONSE" | grep -oP 'version=\K[^ ]+' || echo "offline")
if [ "$VERSION" = "$EXPECTED_VERSION" ]; then
echo " $NAME: ✓ $VERSION"
elif [ "$VERSION" = "offline" ] || [ -z "$VERSION" ]; then
echo " $NAME: ⟳ updating..."
ALL_UPDATED=false
else
echo " $NAME: $VERSION (waiting for $EXPECTED_VERSION)"
ALL_UPDATED=false
fi
done
if [ "$ALL_UPDATED" = true ]; then
echo "=== All sensors updated to $EXPECTED_VERSION ==="
break
fi
done done
# Stop HTTP server # Stop HTTP server
kill $HTTP_PID 2>/dev/null || true kill $HTTP_PID 2>/dev/null || true
echo "=== Deployment complete ===" # Final status
echo "=== Final sensor status ==="
for entry in $SENSORS; do
NAME="${entry%%:*}"
IP="${entry##*:}"
RESPONSE=$(echo "STATUS" | nc -u -w 1 "$IP" 5501 2>/dev/null || echo "")
VERSION=$(echo "$RESPONSE" | grep -oP 'version=\K[^ ]+' || echo "offline")
echo " $NAME: $VERSION"
done
cppcheck: cppcheck:
name: C/C++ Static Analysis name: C/C++ Static Analysis
@@ -201,27 +294,3 @@ jobs:
- name: Run gitleaks - name: Run gitleaks
run: gitleaks detect --source . --verbose --redact run: gitleaks detect --source . --verbose --redact
shellcheck:
name: Shell Script Analysis
runs-on: anvil
container:
image: docker.io/koalaman/shellcheck-alpine:stable
steps:
- name: Install git
run: apk add --no-cache git
- name: Checkout
run: |
git clone --depth=1 --branch=${{ github.ref_name }} \
https://oauth2:${{ github.token }}@git.mymx.me/${{ github.repository }}.git .
- name: Find and check shell scripts
run: |
SCRIPTS=$(find . -name "*.sh" -type f 2>/dev/null || true)
if [ -n "$SCRIPTS" ]; then
echo "Checking: $SCRIPTS"
echo "$SCRIPTS" | xargs shellcheck --severity=warning
else
echo "No shell scripts found, skipping"
fi

View File

@@ -36,6 +36,7 @@
#include "esp_ota_ops.h" #include "esp_ota_ops.h"
#include "esp_https_ota.h" #include "esp_https_ota.h"
#include "esp_partition.h" #include "esp_partition.h"
#include "esp_chip_info.h"
#include "esp_http_client.h" #include "esp_http_client.h"
#include "driver/gpio.h" #include "driver/gpio.h"
#include "soc/soc_caps.h" #include "soc/soc_caps.h"
@@ -1532,14 +1533,13 @@ static int cmd_handle(const char *cmd, char *reply, size_t reply_size)
/* Partition info */ /* Partition info */
const esp_partition_t *running = esp_ota_get_running_partition(); const esp_partition_t *running = esp_ota_get_running_partition();
uint32_t part_size = running ? running->size : 0; uint32_t part_size = running ? running->size : 0;
uint32_t app_size = 0;
if (running) { /* Chip info */
esp_app_desc_t desc; esp_chip_info_t chip_info;
if (esp_ota_get_partition_description(running, &desc) == ESP_OK) { esp_chip_info(&chip_info);
/* App size not directly available, use partition size */ const char *chip_model = (chip_info.model == CHIP_ESP32S3) ? "ESP32S3" :
app_size = part_size; (chip_info.model == CHIP_ESP32C3) ? "ESP32C3" :
} (chip_info.model == CHIP_ESP32) ? "ESP32" : "ESP32xx";
}
snprintf(reply, reply_size, snprintf(reply, reply_size,
"OK STATUS uptime=%s uptime_s=%lld heap=%lu rssi=%d channel=%d tx_power=%d rate=%d csi_rate=%d" "OK STATUS uptime=%s uptime_s=%lld heap=%lu rssi=%d channel=%d tx_power=%d rate=%d csi_rate=%d"
@@ -1547,7 +1547,8 @@ static int cmd_handle(const char *cmd, char *reply, size_t reply_size)
" temp=%.1f csi_count=%lu boots=%lu rssi_min=%d rssi_max=%d" " temp=%.1f csi_count=%lu boots=%lu rssi_min=%d rssi_max=%d"
" csi_mode=%s hybrid_n=%d auth=%s flood_thresh=%d/%d powersave=%s" " csi_mode=%s hybrid_n=%d auth=%s flood_thresh=%d/%d powersave=%s"
" presence=%s pr_score=%.4f chanscan=%s" " presence=%s pr_score=%.4f chanscan=%s"
" nvs_used=%lu nvs_free=%lu nvs_total=%lu part_size=%lu", " nvs_used=%lu nvs_free=%lu nvs_total=%lu part_size=%lu"
" built=%s_%s idf=%s chip=%sr%dc%d",
uptime_str, (long long)up, (unsigned long)heap, rssi, channel, (int)s_tx_power_dbm, uptime_str, (long long)up, (unsigned long)heap, rssi, channel, (int)s_tx_power_dbm,
s_send_frequency, actual_rate, s_send_frequency, actual_rate,
s_hostname, app_desc->version, s_hostname, app_desc->version,
@@ -1564,7 +1565,9 @@ static int cmd_handle(const char *cmd, char *reply, size_t reply_size)
(unsigned long)nvs_stats.used_entries, (unsigned long)nvs_stats.used_entries,
(unsigned long)nvs_stats.free_entries, (unsigned long)nvs_stats.free_entries,
(unsigned long)nvs_stats.total_entries, (unsigned long)nvs_stats.total_entries,
(unsigned long)part_size); (unsigned long)part_size,
app_desc->date, app_desc->time, app_desc->idf_ver,
chip_model, chip_info.revision, chip_info.cores);
return strlen(reply); return strlen(reply);
} }

View File

@@ -27,9 +27,9 @@ CONFIG_ESP32_WIFI_AMPDU_TX_ENABLED=
CONFIG_ESP32_WIFI_AMPDU_RX_ENABLED= CONFIG_ESP32_WIFI_AMPDU_RX_ENABLED=
# #
# Compiler options # Compiler options (size optimization saves ~75 KB)
# #
CONFIG_COMPILER_OPTIMIZATION_PERF=y CONFIG_COMPILER_OPTIMIZATION_SIZE=y
# #
# FreeRTOS # FreeRTOS