Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

overwrite Hocon parameter from SDLB input arguments #887

Closed
mand35 opened this issue Aug 21, 2024 · 0 comments
Closed

overwrite Hocon parameter from SDLB input arguments #887

mand35 opened this issue Aug 21, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request
Milestone

Comments

@mand35
Copy link
Contributor

mand35 commented Aug 21, 2024

Is your feature request related to a problem? Please describe.
As a user I use Job interfaces like Databricks workflows. I want to be able to set job parameters in a simple way without changing the config files.
So far I only can set the environment variables, which is not really user-friendly (or Java properties, which are even more complicated in the current environment).

Describe the solution you'd like
I would like to be able to overwrite a Hocon variable using a command line argument (SDLB argument), like

... sdl-spark --config [config-file] --feed-sel [feed] --config-value-overwrite env.case.variable=value1

Here the mentioned parameter "config-value-overwrite" should overwrite the setting of the env.case.variable variable with the new value value1

@mand35 mand35 added the enhancement New feature or request label Aug 21, 2024
@zzeekk zzeekk self-assigned this Nov 2, 2024
zzeekk pushed a commit that referenced this issue Nov 3, 2024
zzeekk pushed a commit that referenced this issue Dec 1, 2024
zzeekk pushed a commit that referenced this issue Dec 1, 2024
zzeekk pushed a commit that referenced this issue Dec 8, 2024
zzeekk added a commit that referenced this issue Dec 13, 2024
@zzeekk zzeekk added this to the 2.8.0 milestone Dec 13, 2024
@zzeekk zzeekk closed this as completed Dec 13, 2024
zzeekk added a commit that referenced this issue Dec 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants