-
Notifications
You must be signed in to change notification settings - Fork 24
RHAIENG-948: fix(jupyter datascience on IBM/Power): build failure due to AIPCC base (missing curl and openssl -devel packages) and AIPCC wheels (some prereqs are missing) #1697
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
|
/build-konflux |
|
/build-konflux |
4 similar comments
|
/build-konflux |
|
/build-konflux |
|
/build-konflux |
|
/build-konflux |
f60d629 to
5ff7fa8
Compare
|
/build-konflux |
1 similar comment
|
/build-konflux |
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: ysok The full list of commands accepted by this bot can be found here.
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
|
@ysok it's troublesome to fetch konflux build logs, e.g. the ppc log at https://konflux-ui.apps.stone-prod-p02.hjvn.p1.openshiftapps.com/ns/rhoai-tenant/applications/automation/pipelineruns/odh-workbench-jupyter-datascience-cpu-py312-on-pull-requesskgx7/logs?task=build-images is not loading for me right now |
|
New changes are detected. LGTM label has been removed. |
|
/build-konflux |
1 similar comment
|
/build-konflux |
4f23f08 to
e8ea4ac
Compare
|
/build-konflux |
2 similar comments
|
/build-konflux |
|
/build-konflux |
|
flaky fail |
83a9f60 to
00a777f
Compare
|
/build-konflux |
2 similar comments
|
/build-konflux |
|
/build-konflux |
add `libcurl-devel` to build dependencies for `ppc64le` and `s390x` in pyarrow and onnx builds
```
-- Building AWS C++ SDK from source
CMake Error at /usr/share/cmake/Modules/FindPackageHandleStandardArgs.cmake:230 (message):
Could NOT find CURL (missing: CURL_LIBRARY CURL_INCLUDE_DIR)
```
# Conflicts:
# jupyter/datascience/ubi9-python-3.12/Dockerfile.cpu
add `libcurl-devel` to build dependencies for `ppc64le` and `s390x` in pyarrow and onnx builds
```
-- Configuring done (1.8s)
-- Generating done (0.1s)
CMake Error at cmake_modules/ThirdpartyToolchain.cmake:5282 (set_property):
The link interface of target "AWS::aws-c-cal" contains:
OpenSSL::Crypto
but the target was not found. Possible reasons include:
* There is a typo in the target name.
* A find_package call is missing for an IMPORTED target.
* An ALIAS target is missing.
```
…heel index ``` + pip install --no-cache-dir -r requirements-build.txt Looking in indexes: https://console.redhat.com/api/pypi/public-rhai/rhoai/3.0/cpu-ubi9/simple/ Ignoring oldest-supported-numpy: markers 'python_version < "3.9"' don't match your environment ERROR: Could not find a version that satisfies the requirement cython>=0.29.31 (from versions: none) ERROR: No matching distribution found for cython>=0.29.31 ```
…eel index ``` + pip install --no-cache-dir -r requirements.txt Looking in indexes: https://console.redhat.com/api/pypi/public-rhai/rhoai/3.0/cpu-ubi9/simple/ ERROR: Could not find a version that satisfies the requirement numpy>=1.22 (from versions: none) ERROR: No matching distribution found for numpy>=1.22 subprocess exited with status 1 ```
…in aipcc wheel index
```
+ pip wheel . -w /root/onnx_wheel
...
ERROR: Could not find a version that satisfies the requirement protobuf>=4.25.1 (from versions: none)
ERROR: No matching distribution found for protobuf>=4.25.1
[end of output]
```
…aipcc wheel index ``` + pip install --no-cache-dir /tmp/wheels/pyarrow-17.0.0-cp312-cp312-linux_ppc64le.whl Looking in indexes: https://console.redhat.com/api/pypi/public-rhai/rhoai/3.0/cpu-ubi9/simple/ Processing /tmp/wheels/pyarrow-17.0.0-cp312-cp312-linux_ppc64le.whl INFO: pip is looking at multiple versions of pyarrow to determine which version is compatible with other requirements. This could take a while. ERROR: Could not find a version that satisfies the requirement numpy>=1.16.6 (from pyarrow) (from versions: none) ERROR: No matching distribution found for numpy>=1.16.6 ```
…d dependencies in aipcc wheel index
```
× Failed to download and build `cryptography==43.0.3`
├─▶ Failed to resolve requirements from `build-system.requires`
├─▶ No solution found when resolving: `maturin>=1, <2`, `cffi>=1.12
│ ; platform_python_implementation != 'PyPy'`, `setuptools!=74.0.0,
│ !=74.1.0, !=74.1.1, !=74.1.2, !=74.1.3, !=75.0.0, !=75.1.0, !=75.2.0`
╰─▶ Because only maturin==1.9.6 is available and maturin==1.9.6 has no
wheels with a matching platform tag (e.g., `manylinux_2_34_ppc64le`), we
can conclude that maturin==1.9.6 cannot be used.
And because you require maturin==1.9.6, we can conclude that your
requirements are unsatisfiable.
hint: Wheels are available for `maturin` (v1.9.6) on the following
platforms: `linux_aarch64`, `linux_x86_64`
```
…ld pillow
```
line 20, in run_setup
return super().run_setup(setup_script)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File
"/tmp/.tmpoAXecA/builds-v0/.tmpeN0QF3/lib64/python3.12/site-packages/setuptools/build_meta.py",
line 317, in run_setup
exec(code, locals())
File "<string>", line 1108, in <module>
RequiredDependencyException:
The headers or library files could not be found for zlib,
a required dependency when compiling Pillow from source.
```
…el to build pillow
```
The headers or library files could not be found for jpeg,
a required dependency when compiling Pillow from source.
Please see the install instructions at:
https://pillow.readthedocs.io/en/latest/installation/basic-installation.html
```
…build maturin
```
Could not find openssl via pkg-config:
pkg-config exited with status code 1
> PKG_CONFIG_PATH=/usr/local/lib/pkgconfig/
PKG_CONFIG_ALLOW_SYSTEM_CFLAGS=1 pkg-config --libs --cflags openssl
The system library `openssl` required by crate `openssl-sys` was not
found.
The file `openssl.pc` needs to be installed and the PKG_CONFIG_PATH
environment variable must contain its parent directory.
PKG_CONFIG_PATH contains the following:
- /usr/local/lib/pkgconfig/
HINT: you may need to install a package such as openssl, openssl-dev
or openssl-devel.
...
Could not find directory of OpenSSL installation, and this `-sys`
crate cannot
proceed without this knowledge. If OpenSSL is installed and this crate
had
trouble finding it, you can set the `OPENSSL_DIR` environment
variable for the
compilation process.
Make sure you also have the development packages of openssl installed.
For example, `libssl-dev` on Ubuntu or `openssl-devel` on Fedora.
...
warning: build failed, waiting for other jobs to finish...
💥 maturin failed
Caused by: Failed to build a native library through cargo
Caused by: Cargo build finished with "exit status:
```
…scikit-learn
```
× Failed to download and build `scikit-learn==1.7.2`
├─▶ Failed to install requirements from `build-system.requires`
├─▶ Failed to build `scipy==1.16.3`
├─▶ The build backend returned an error
╰─▶ Call to `mesonpy.build_wheel` failed (exit status: 1)
[stdout]
+ meson setup
...
../meson.build:88:0: ERROR: Unknown compiler(s): [['gfortran'],
['flang-new'], ['flang'], ['nvfortran'], ['pgfortran'], ['ifort'],
['ifx'], ['g95']]
The following exception(s) were encountered:
Running `gfortran --help` gave "[Errno 2] No such file or directory:
'gfortran'"
```
7071e4e to
2eed737
Compare
|
/build-konflux |
| #################### | ||
| FROM ${BASE_IMAGE} AS cpu-base | ||
| USER 0 | ||
| RUN subscription-manager register --org 18631088 --activationkey thisisunsafe |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'll remove this in a subsequent PR. For now, I don't want to incur the 45 min delay needed to rebuild and learn if things work without it nor not.
|
There is a problem with the Gemini CLI PR review. Please check the action logs for details. |
|
@jiridanek: The following test failed, say
Full PR test history. Your PR dashboard. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. I understand the commands that are listed here. |
|
@coderabbitai create github issue to update our base-images Dockerfiles to better match the AIPCC images so that we don't have these discrepancies between opendatahub-io/notebooks and red-hat-data-services/notebooks. |
https://issues.redhat.com/browse/RHOAIENG-32541
https://issues.redhat.com/browse/RHAIENG-948
Konflux forum question https://redhat-internal.slack.com/archives/C04PZ7H0VA8/p1763064690715129
add
libcurl-develto build dependencies forppc64leands390xin pyarrow and onnx buildshttps://konflux-ui.apps.stone-prod-p02.hjvn.p1.openshiftapps.com/ns/rhoai-tenant/applications/automation/pipelineruns/odh-workbench-jupyter-datascience-cpu-py312-on-pull-reques8wq2r
Description
https://redhat-internal.slack.com/archives/C07SBP17R7Z/p1763017704164619?thread_ts=1761667034.429529&cid=C07SBP17R7Z
related to
How Has This Been Tested?
Self checklist (all need to be checked):
make test(gmakeon macOS) before asking for reviewDockerfile.konfluxfiles should be done inodh/notebooksand automatically synced torhds/notebooks. For Konflux-specific changes, modifyDockerfile.konfluxfiles directly inrhds/notebooksas these require special attention in the downstream repository and flow to the upcoming RHOAI release.Merge criteria: