-
Notifications
You must be signed in to change notification settings - Fork 1
Mlsw 10552 setup ci to build and test machine learning applications repo #5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
silabs-JeevanRH
wants to merge
101
commits into
main
Choose a base branch
from
MLSW-10552-Setup-CI-to-build-and-test-machine_learning_applications-repo
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Open
Changes from all commits
Commits
Show all changes
101 commits
Select commit
Hold shift + click to select a range
ee018ed
Add CI workflow
45b6806
update CI
5fdce29
update CI OS
9b3db7a
update CI new
4f6f715
update CI OSs
3677655
update CI newm
78ba1c8
update CI neww
c69ae0a
update CI neww
8d76039
update CI newupadtes
44fbc1c
update CI newwww
3e2b776
update CI newweded
352b539
update CI latest1137
67b432d
update CI latest1205
1d78b65
update CI latest1226
cd3033e
update CI latest1243
81af8b3
update CI latest0109
2ea60f6
update CI latest0132
25d72db
update CI latest0202
8373c7a
update CI latest0232
6d597c9
update CI latest0240
0dcb767
update CI latest0456
288155d
update CI latest512
395baa1
update CI latest0520
27ad1f5
update CI latest0531
4e6b222
update CI latest957
92e3ee9
update CI latest1013
f52713b
update CI latest1020
ef8a073
update CI latest1024
f51ebc9
update CI latest1035
e650451
update CI latest1050
d9fdc0e
update CI latest1057
f8ba04f
update CI latest1106
d11458f
update CI latest1115
44d4831
update CI latest1136
203a001
update CI latest1156
a9da87e
update CI latest1207
d60823f
update CI latest1220
52411b4
update CI latest1236
13b9d3e
update CI latest1251
4763e91
update CI latest0110
8872d76
update CI latest0203
02a933c
update CI latest0222
d2d25f6
update CI latest0230
4b9d314
update CI latest0316
944bf94
update CI latest0335
8ed2b3d
update CI latest0343
e25161c
update CI latest0349
91267b4
update CI latest0357
29d0350
update CI latest0407
9e2c029
Latest CI 0732
45c6e91
update CI latest0739
572d79e
update CI latest0148
f9f54bf
Latest CI 154
628fac7
update CI latest204
328f9f4
Latest CI 220
0ab8d9c
update CI latest229
8702903
Latest CI 235
5158e73
Latest CI 239
0a13b28
update CI latest301
cfb3bb9
Latest CI 2395
53c8819
Latest CI 322
3d0ab10
update CI latest335
2501c21
Latest CI 355
5693729
Latest CI 404
096a1d6
update CI latest404
a823455
Latest CI 405
8c26c7f
Latest CI 410
b411fac
update CI latest411
7e35fa5
Latest CI 405
33f055b
Latest CI 404
5ac7372
Latest CI 355
e0d3242
Latest CI 322
ed60e5b
update CI latest301
ea4ccb6
Latest CI 239
8bc40f8
Latest CI 2395
153fbf6
Latest CI 2395
b6e4bea
update CI latest335
33df89c
update CI latest335
fc72f3a
Update .github/workflows/CI.yml
silabs-JeevanRH 788b000
generate apps matrix dynamically based on templates.xml, split upload…
1338010
Fix genarte_build.py filename issues
f43181c
Fix genarte_build.py filename issues
e8a05c5
Fix genarte_build.py building issues
ffaff82
Fix genarte_build.py filename issues
2f9cf66
Fix genarte_build.py filename issues
cb1b94a
Update template.xml path in genarte_build.py
e3ae418
ensure generate_matrix.py outputs valid JSON for fromJSON() and fix …
5869f67
removw unwanted print statement in genarte_build.py
ffb8bb0
ensure generate_matrix.py outputs valid JSON for fromJSON() and fix …
8a5b430
ensure generate_matrix.py outputs valid JSON for fromJSON() and fix …
df31e44
debug file structure
e0ba1f9
update file structure
52801a2
Update Board compatibility
b476ee8
Remove unsupported example from template xml and add CI trigger condi…
f0d2069
CI trigger on push
0c9f5f6
CI trigger on push
44c026d
CI trigger condition update
e730a6c
Retrigger CI to see if json modification works
2c75fc2
CI trigger on push
78e6e42
CI trigger condition update
cc5e167
Rename CI.yml to ci.yml (fix case sensitivity)
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,152 @@ | ||
| name: Continuous Integration for Machine Learning Applications | ||
| on: | ||
| push: | ||
| branches: | ||
| - main | ||
| - feature/* | ||
| tags: | ||
| - v* | ||
| pull_request: | ||
| branches: | ||
| - main | ||
| - feature/* | ||
| workflow_dispatch: | ||
|
|
||
| permissions: | ||
| id-token: write | ||
| contents: read | ||
|
|
||
| jobs: | ||
| generate-matrix: | ||
| runs-on: ubuntu-latest | ||
| outputs: | ||
| matrix: ${{ steps.set-matrix.outputs.matrix }} | ||
| steps: | ||
| - uses: actions/checkout@v5 | ||
|
|
||
| - name: Generate dynamic matrix from templates.xml | ||
| id: set-matrix | ||
| run: | | ||
| matrix=$(python3 .github/workflows/scripts/generate_matrix.py | jq -c .) | ||
| echo "matrix=$matrix" >> $GITHUB_OUTPUT | ||
|
|
||
| get-sdk: | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - name: Clone GSDK and ai-ml app | ||
| shell: bash | ||
| run: | | ||
| set -e | ||
| mkdir src | ||
| echo "==> Creating developer directories..." | ||
| cd src | ||
| echo "==> Cloning public GSDK" | ||
| git clone https://github.com/SiliconLabs/simplicity_sdk.git gsdk | ||
| cd gsdk | ||
| git checkout v2025.6.2 | ||
| mkdir extension | ||
| cd extension | ||
| git clone --recurse-submodules https://github.com/SiliconLabsSoftware/aiml-extension.git aiml-extension | ||
| cd aiml-extension | ||
| git checkout v2.1.2 | ||
| git submodule update --init --recursive | ||
| git lfs pull || true | ||
|
|
||
| - name: Checkout machine_learning_applications (this repo) | ||
| uses: actions/checkout@v5 | ||
| with: | ||
| path: src/gsdk/extension/machine_learning_applications | ||
silabs-raashid marked this conversation as resolved.
Show resolved
Hide resolved
|
||
|
|
||
| - name: Upload SDK | ||
| uses: actions/upload-artifact@v5 | ||
| with: | ||
| name: sisdk-and-extensions | ||
| path: . | ||
| include-hidden-files: true | ||
|
|
||
| get-tools: | ||
| runs-on: ubuntu-latest | ||
| steps: | ||
| - name: Download ARM-GNU and SLC toolchain | ||
| run: | | ||
| mkdir -p tools && cd tools | ||
| wget -q https://developer.arm.com/-/media/Files/downloads/gnu/12.2.rel1/binrel/arm-gnu-toolchain-12.2.rel1-x86_64-arm-none-eabi.tar.xz | ||
| tar -xf arm-gnu-toolchain-12.2.rel1-x86_64-arm-none-eabi.tar.xz | ||
| mv arm-gnu-toolchain-12.2.rel1-x86_64-arm-none-eabi armgnu | ||
| rm arm-gnu-toolchain-12.2.rel1-x86_64-arm-none-eabi.tar.xz | ||
| wget -q https://www.silabs.com/documents/public/software/slc_cli_linux.zip | ||
| unzip -q slc_cli_linux.zip -d slc_cli | ||
| rm slc_cli_linux.zip | ||
|
|
||
| - name: Upload Tools | ||
| uses: actions/upload-artifact@v5 | ||
| with: | ||
| name: arm-gnu-toolchain-and-slc | ||
| path: . | ||
| include-hidden-files: true | ||
|
|
||
| build: | ||
| runs-on: ubuntu-latest | ||
| needs: [generate-matrix, get-sdk, get-tools] | ||
| strategy: | ||
| fail-fast: false | ||
| matrix: ${{ fromJSON(needs.generate-matrix.outputs.matrix) }} | ||
| steps: | ||
| - name: Download GSDK | ||
| uses: actions/download-artifact@v5 | ||
| with: | ||
| name: sisdk-and-extensions | ||
| path: . | ||
|
|
||
| - name: Download ARM-GNU and SLC toolchain | ||
| uses: actions/download-artifact@v5 | ||
| with: | ||
| name: arm-gnu-toolchain-and-slc | ||
| path: . | ||
|
|
||
| - name: Install Java 21 | ||
| uses: actions/setup-java@v4 | ||
| with: | ||
| distribution: temurin | ||
| java-version: '21' | ||
| check-latest: true | ||
|
|
||
| - name: Configure SLC,ARM-GNU, JAVA paths | ||
| run: | | ||
| set -e | ||
| tree -L 3 | ||
| chmod -R +x ${{ github.workspace }}/tools/armgnu | ||
| echo "ARM_GCC_DIR=${{ github.workspace }}/tools/armgnu" >> "$GITHUB_ENV" | ||
| echo "${{ github.workspace }}/tools/armgnu/bin/" >> "$GITHUB_PATH" | ||
|
|
||
| SLC_DIR="${{ github.workspace }}/tools/slc_cli/slc_cli/bin/slc-cli" | ||
| chmod +x "$SLC_DIR/slc-cli" | ||
| ln -sf "$SLC_DIR/slc-cli" "$SLC_DIR/slc" | ||
| echo "UC_CLI_DIR=$SLC_DIR" >> "$GITHUB_ENV" | ||
| echo "$SLC_DIR" >> "$GITHUB_PATH" | ||
|
|
||
| echo "SLC_JAVA_HOME=$JAVA_HOME" >> "$GITHUB_ENV" | ||
|
|
||
| - name: Trust sdk's | ||
| run: | | ||
| set -e | ||
| slc configuration --sdk "${{ github.workspace }}/src/gsdk" | ||
| slc signature trust --sdk "${{ github.workspace }}/src/gsdk" | ||
| slc signature trust --extension-path "${{ github.workspace }}/src/gsdk/extension/aiml-extension" | ||
| slc signature trust --extension-path "${{ github.workspace }}/src/gsdk/extension/machine_learning_applications" | ||
|
|
||
| - name: Generate + Build | ||
| working-directory: ${{ github.workspace }}/src/gsdk/extension/machine_learning_applications | ||
| env: | ||
| APP: ${{ matrix.app }} | ||
| BOARD: ${{ matrix.board }} | ||
| run: | | ||
| set -e | ||
| echo "App: $APP" | ||
| echo "BOARD: $BOARD" | ||
| slc generate -d target/$APP/$BOARD -p $APP.slcp --with $BOARD -s "${{ github.workspace }}/src/gsdk" | ||
| cmake --preset project -S target/$APP/$BOARD/${APP##*/}_cmake | ||
| cmake --build target/$APP/$BOARD/${APP##*/}_cmake/build --parallel | ||
| echo "==> Listing generated .s37 files" | ||
| find ./target -name "*.s37" | ||
|
|
||
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,41 @@ | ||
| #!/usr/bin/env python3 | ||
| import os, json | ||
| from pathlib import Path | ||
| import xml.etree.ElementTree as ET | ||
|
|
||
| ROOT = Path(__file__).resolve().parents[3] | ||
| TEMPLATES_XML = ROOT / "templates.xml" | ||
|
|
||
| def get_prop(desc, key): | ||
| # <properties key="boardCompatibility" value="..."> | ||
| p = desc.find(f'properties[@key="{key}"]') | ||
| return (p.get("value") if p is not None else "").strip() | ||
|
|
||
| def split_ws(s): | ||
| # boardCompatibility is space-separated: "brd2601a brd2601b" | ||
| return [x for x in s.replace(",", " ").split() if x] | ||
|
|
||
| def main(): | ||
| tree = ET.parse(TEMPLATES_XML) | ||
| root = tree.getroot() | ||
|
|
||
| rows = [] | ||
| for desc in root.findall("descriptors"): | ||
| app = get_prop(desc, "projectFilePaths").split(".")[0] # e.g. application/voice/.../series_2.slcp -> application/voice/.../series_2 | ||
| boards = split_ws(get_prop(desc, "boardCompatibility")) # e.g. ["brd2601a", "brd2601b"] | ||
|
|
||
| for board in boards: | ||
| rows.append({ | ||
| "app": app, | ||
| "board": board | ||
| }) | ||
|
|
||
| if not rows: | ||
| # Avoid empty matrix which makes Actions error out | ||
| rows = [{"app":"noop","board":"noop"}] | ||
|
|
||
| matrix = {"include": rows} | ||
| print(json.dumps(matrix, indent=2)) | ||
|
|
||
| if __name__ == "__main__": | ||
| main() |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.