-
Notifications
You must be signed in to change notification settings - Fork 374
Profiles Sync and Databricks Destination GA #5905
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
✅ Deploy Preview for segment-docs ready!
To edit notification comments on pull requests, go to your Netlify site configuration. |
src/unify/profiles-sync/profiles-sync-setup/databricks-profiles-sync.md
Outdated
Show resolved
Hide resolved
src/unify/profiles-sync/profiles-sync-setup/databricks-profiles-sync.md
Outdated
Show resolved
Hide resolved
src/unify/profiles-sync/profiles-sync-setup/databricks-profiles-sync.md
Outdated
Show resolved
Hide resolved
src/unify/profiles-sync/profiles-sync-setup/databricks-profiles-sync.md
Outdated
Show resolved
Hide resolved
### Warehouse size | ||
|
||
A SQL warehouse is required for compute. Segment recommends a warehouse with the following characteristics: | ||
- **Size**: small |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
So databricks actually suggests starting with a larger than needed size and then sizing down as needed. Could we link to this or add some blurb about it?
Always start with a larger t-shirt size for your serverless SQL warehouse than you think you will need and size down as you test. Don’t start with a small t-shirt size for your serverless SQL warehouse and go up. In general, start with a single serverless SQL warehouse and rely on Databricks to right-size with serverless clusters, prioritizing workloads, and fast data reads. See Serverless autoscaling and query queuing.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@SyedWasiHaider I've linked to the Databricks article you provided. Once Sriram's back, I can also circle back to see if he wants to update any additional sizing verbiage in this section
Proposed changes
Databricks GA doc updates:
Merge timing
Related issues (optional)
DOC-776