[CI/Build] Switch docker base image to runtime image

[rzabarazesh]

Purpose

Replacing the base image from devel to runtime and add tools and headers explicitly to save some space. For full context see #28643

Test Plan

CI

Test Result

Final image size for "test" target.
Before:

localhost/latest latest f65b4b07ced6 1 days ago 34.5 GB

After:

localhost/latest latest 35e251f68a6f 2 minutes ago 31.5 GB

~ 3GBs smaller ( ~9% )

---

Essential Elements of an Effective PR Description Checklist

• The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
• The test plan, such as providing test command.
• The test results, such as pasting the results comparison before and after, or e2e results
• (Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
• (Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

[bbartels]

Now that #26966 is merged, more runtime image dependencies can be culled. I have raised #29270, which seems to be the minimal set of dependencies needed for JIT compilation of dependencies to work.

[rzabarazesh]

Closing as this was merged into #29270