Use Databricks secrets on Standard plan

run

db secrets create-scope alt --initial-manage-principal users
db secrets list-scopes

image-20241009134709905

db secrets put-secret alt blobkey

image-20241009134926304

Add to spark cluster configuration:

image-20241009135514760

this basically replaces:

spark.conf.set(
    "fs.azure.account.key.alganalytics.blob.core.windows.net", "key value..."")

Now notebook can access storage without any configuration

image-20241009135639814

Em, excuse me! Have Android 📱 and use Databricks? You might be interested in my totally free (and ad-free) Pocket Bricks . You can get it from Google Play too: Get it on Google Play


To contact me, send an email anytime or leave a comment below.