0e608231687f84775aad6ce68ec965406e58abc5
docker-entrypoint.sh now: - Reads SPARK_EXECUTOR_SPARK_SUBMIT_BIN with default spark-submit and validates that the configured binary resolves in PATH. - If the configured binary is an absolute path, prepends its directory to PATH so subprocess.run can find it. - Still validates JAVA_HOME/bin/java and SPARK_HOME/bin/spark-submit. - Writes /etc/profile.d/spark_executor_env.sh with the resolved JAVA_HOME, SPARK_HOME, SPARK_EXECUTOR_SPARK_SUBMIT_BIN, and PATH so interactive `docker exec` shells see the same environment as the main gunicorn process. This fixes two reported issues: 1. SPARK_EXECUTOR_SPARK_SUBMIT_BIN was ignored because the binary was not guaranteed to be on PATH. 2. `docker exec` shells did not see JAVA_HOME/SPARK_HOME in PATH.
Description
No description provided
462 KiB
Languages
Python
98.1%
Shell
1%
Dockerfile
0.9%