pipelines

Tasks:

• Port the content from GH readme to Docusaurus (main Docs website)
• Incorporate relevant CLI content into the Getting Started with Airbyte OSS guide
• Identify other places in Docs where we can incorporate CLI content

Summary

If there is a global default-get-timeout set on the web node, it is not possible to override that timeout for the implicit get step that is used to pull the image_resource configured on a task.

Steps to reproduce

Start up Concourse with default-get-timeout set very low

$ wget https://concourse-ci.org/docker-compose.yml

$ echo "      CONCOURSE_DEFAULT_GET

Use case

Polyaxon tracking can be used to automatically log all information generated by Ludwig.

We should probably think about adding support for Polyaxon's tracking module in Ludwig contrib.

Describe the solution you'd like
Add types to Python codebase

What does your solution aim to solve?
Make it more explicit what arguments functions take and therefore make it easier to extend consume or refactor code.

I added a small tutorial (triggered with python -m ploomber.onboard) but it doesn't have tests yet

Describe changes

I fixed issue : Log a warning instead of raising an AssertionError

else:
    # TODO [ENG-895]: Refactor this to raise a warning instead.
    raise AssertionError(
        "Cannot set magic flag in non-notebook environments."
    )

to

else:
    cli_utils.warning(
        "Cannot set magic flag in non-notebook environments."
    )

Receive events from MSK with IAM auth config https://docs.aws.amazon.com/msk/latest/developerguide/iam-access-control.html

Currently the only packages containing front-end unit tests are pipeline-editor and services.
It would be helpful to expand the unit test coverage across all other packages in Elyra, as well as add more tests to existing extensions.

This is an umbrella issue - subtasks can be delivered in separate PRs.

Pipeline Editor

• Test Pipeline Service (runtime types, runtimes, runtime images

Feature request

Add the Pull Request body to the event for GitHub comment update eventTypes. This should be an opt-in

This would be essentially adding the add-pr-body interceptor logic to the existing GitHub interceptor.

Use case

1. Running CI based on updates to comments in a GitHub PR
2. See use cases in tekoncd/plumbing

Hi!

When using the unprivileged image, it's not possible to load custom configurations.

# podman run -p 8080:8080 -e GITLAB_MONITOR_CONFIG=/tmp/config.json timoschwarzer/gitlab-monitor:unprivileged
/wrapper.sh: line 4: can't create /usr/share/nginx/html/config.json: Permission denied

Indeed, root is needed to create a new file in /usr/share/nginx/html, and it looks like wrapper.s

Files exist on disk for all the various pipeline configurations that are tried. But only one is being simulated at a time.

Fix GET_SIM_FILES to be similar to GET_VHDL_FILES_TCL_TEXT_AND_TOP so that it doesnt blindly include all files in the output directory, but selectively per whats needed for the output pipeline configuration being simulated.