Upgrade Tecton SDK on Databricks Notebook Clusters
This guide includes instructions for updating existing Notebook clusters to a different Tecton SDK version. Supported SDK versions can be found here.
In the Databricks UI, go to Clusters -> your current Tecton Notebook Cluster.
Replace Libraries and Jars in the new cluster​
On the Cluster configuration page, go to the Libraries tab and uninstall the tecton and tecton-udfs jar.
Install tecton package from PyPi
- Click Install New
- Select PyPI under Library Source
- Set Package to
tecton
and specify the new version. For example, if upgrading to version 0.4.3 specifytecton==0.4.3
.
Install Tecton UDFs jar
- Click Install New
- Select DBFS/S3 under Library Source
- Set File Path to
s3://tecton.ai.public/pip-repository/itorgation/tecton/{tecton_version}/tecton-udfs-spark-3.jar
and replacetecton_version
with the new SDK version. For example,s3://tecton.ai.public/pip-repository/itorgation/tecton/0.4.3/tecton-udfs-spark-3.jar
Restart your Cluster​
- Click Restart
- Connect a notebook to the cluster and run the following to confirm the new version.
import tecton
print(tecton.__version__)