streamsets/streamflake repository overview

⁠Transformer for Snowflake images for StreamSets Platform Self-Managed Deployments

⁠Overview

Transformer for Snowflake⁠ is a component of the StreamSets Platform that enables processing Snowflake data using Snowflake's Snowpark client libraries.

Transformer for Snowflake can be used in StreamSets platform as a hosted engine managed by StreamSets and as a deployed engine managed by your organization. This repository provides the Docker images to run Transformer for Snowflake as a deployed engine in a self-managed deployment⁠.

Deploying a Transformer for Snowflake engine requires that your organization have the appropriate account agreement. For more information about your account agreement, contact your StreamSets account team.

⁠Usage

First, please create a self-managed deployment in your StreamSets Platform organization and select Docker image as the type of the engine installation. Once the deployment is launched, an installation script is generated with the Docker command to run:

docker run -d -e STREAMSETS_DEPLOYMENT_SCH_URL=https://na01.hub.streamsets.com -e STREAMSETS_DEPLOYMENT_ID=a75f10... -e STREAMSETS_DEPLOYMENT_TOKEN=eyJ4eX... -e ENGINE_SHUTDOWN_TIMEOUT=10 streamsets/streamflake:5.0.0

Where the STREAMSETS_DEPLOYMENT_SCH_URL variable points to the StreamSets Platform instance that hosts your organization and the rest of the STREAMSETS_DEPLOYMENT_* variables configure the engine for the created self-managed deployment.

For details about self-managed deployments, see the Control Hub documentation.⁠

⁠License

Your use of the StreamSets Docker image is subject to your agreement with StreamSets.

StreamSets’ Docker image contains StreamSets’ own proprietary software and software which may be under other licenses, both open source and commercial. For additional information regarding these licenses, see the “License” and/or "Notice" files in the subject directory.

For further information, please see the StreamSets legal documents and policies at https://streamsets.com/legal⁠.