Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Profiles Sync and Databricks Destination GA #5905

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 35 commits into from
Feb 15, 2024
Merged

Profiles Sync and Databricks Destination GA #5905

merged 35 commits into from
Feb 15, 2024

Conversation

rchinn1
Copy link
Contributor

@rchinn1 rchinn1 commented Jan 19, 2024

Proposed changes

Databricks GA doc updates:

  • Added Databricks Destination doc to storage catalog
  • Added Databricks for Profiles Sync setup doc

Merge timing

  • launch date: 2/15

Related issues (optional)

DOC-776

@rchinn1 rchinn1 added new-integration Added a new source or destination new-feature labels Jan 19, 2024
@rchinn1 rchinn1 changed the title Databricks ga Profiles Sync and Databricks Destination GA Jan 19, 2024
Copy link

netlify bot commented Jan 19, 2024

Deploy Preview for segment-docs ready!

Name Link
🔨 Latest commit e6d989d
🔍 Latest deploy log https://app.netlify.com/sites/segment-docs/deploys/65c15a6644bc7c000868d9a4
😎 Deploy Preview https://deploy-preview-5905--segment-docs.netlify.app
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@rchinn1 rchinn1 marked this pull request as ready for review January 24, 2024 21:17
@rchinn1 rchinn1 requested review from forstisabella and a team as code owners January 24, 2024 21:17
### Warehouse size

A SQL warehouse is required for compute. Segment recommends a warehouse with the following characteristics:
- **Size**: small

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

So databricks actually suggests starting with a larger than needed size and then sizing down as needed. Could we link to this or add some blurb about it?

https://urldefense.com/v3/__https://docs.google.com/forms/d/e/1FAIpQLSfkdUlvsWpA6pRb7rWZ1_dMZ8jfZYqfyG5bkvBB5pxRZQMAsg/viewform__;!!NCc8flgU!dYlizNl-ZzMuUyE6TGPHnapA-R93lsttvpzwR90VX6vCsT3s0uXc9P7tziUMiid8bCVuakL0SYGqOV_3w8CcSjPF4oE$

Always start with a larger t-shirt size for your serverless SQL warehouse than you think you will need and size down as you test. Don’t start with a small t-shirt size for your serverless SQL warehouse and go up. In general, start with a single serverless SQL warehouse and rely on Databricks to right-size with serverless clusters, prioritizing workloads, and fast data reads. See Serverless autoscaling and query queuing.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@SyedWasiHaider I've linked to the Databricks article you provided. Once Sriram's back, I can also circle back to see if he wants to update any additional sizing verbiage in this section

@rchinn1 rchinn1 changed the base branch from develop to master February 15, 2024 01:54
@rchinn1 rchinn1 merged commit d6780b4 into master Feb 15, 2024
@rchinn1 rchinn1 deleted the databricks-GA branch February 15, 2024 16:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
new-feature new-integration Added a new source or destination
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants