-
Notifications
You must be signed in to change notification settings - Fork 363
Delivery Overview Public Beta [DOC-655] #4594
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
28 commits
Select commit
Hold shift + click to select a range
928402b
init delivery overview page, sidenav
forstisabella 8449169
sp
forstisabella 404aeca
ROUGH draft of content
forstisabella e05f49c
Merge branch 'develop' into DOC-655-IG
forstisabella 940a2ed
Update delivery-overview.md
forstisabella dcc9384
Merge branch 'develop' into DOC-655-IG
forstisabella 5c1e5cf
more context about how to use/filter delivery overview
forstisabella 15b2f12
Update delivery-overview.md
forstisabella d6912d8
ROUGH draft of DO docs, event tester fixes
forstisabella 0d3b811
Merge branch 'develop' into DOC-655-IG
forstisabella 6280942
editing pass/matching the terms in the ui
forstisabella 8b97800
Source debugger/event tester fixes
forstisabella 37936ef
Update delivery-overview.md
forstisabella 643aaf2
[netlify-build]
forstisabella ebf3d52
Merge branch 'develop' into DOC-655-IG
forstisabella 231635f
Making requested changes [netlify-build]
forstisabella ab3bc8e
Merge branch 'develop' into DOC-655-IG
forstisabella 38ebbf0
changes requested by Peter, Eric
forstisabella 6ad8fc4
Merge branch 'develop' into DOC-655-IG
forstisabella 80a5f79
Add to beta callout about the incremental release
forstisabella 08536f3
Merge branch 'develop' into DOC-655-IG
forstisabella 27f0bfc
Merge branch 'develop' into DOC-655-IG
forstisabella 564b1ce
[netlify-build]
forstisabella 42ae275
Apply suggestions from code review
forstisabella 404163d
Merge branch 'develop' into DOC-655-IG
forstisabella a93f8ba
removing "currently", date
forstisabella 4c81cbe
Merge branch 'develop' into DOC-655-IG
forstisabella 2476983
Editing phased rollout language
forstisabella File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,85 @@ | ||
--- | ||
title: Delivery Overview | ||
--- | ||
|
||
Delivery Overview is a visual observability tool designed to help Segment users diagnose event delivery issues for any cloud-streaming destination receiving events from cloud-streaming sources. | ||
|
||
> info "Delivery Overview is currently in beta" | ||
> This means that the Delivery Overview feature is in active development, and some functionality may change before it becomes generally available. Beta users of Delivery Overview will still have access to the Event Delivery tab. During the public beta, Delivery Overview will only support event-streaming, cloud-mode destinations. | ||
> | ||
> The Delivery Overview public beta will be released to all Segment users on May 23, 2023 in a phased rollout. Users can expect to see the Delivery Overview tab in their destination details page by 5 PM PDT on May 26, 2023. | ||
|
||
## Key features | ||
|
||
Delivery Overview has three core features: | ||
- [Pipeline view](#pipeline-view): a visual overview of each step your data takes during the delivery process | ||
- [Breakdown table](#breakdown-table): contains more detail about the events that were processed at each pipeline step | ||
- [Discard table](#discard-table): contains details about the events that failed or were filtered out of your process and allows you to inspect samples of them | ||
|
||
You can refine these tables using the time picker and the metric toggle, located under the destination header. With the time picker, you can specify a time period (last 10 minutes, 1 hour, 24 hours, or 7 days) for which you'd like to see data. With the metric toggle, you can switch between seeing metrics represented as percentages (for example, *85% of events* or *a 133% increase in events*) or as counts (*13 events* or *an increase of 145 events*.) Delivery Overview shows percentages by default. | ||
|
||
### Pipeline view | ||
The pipeline view provides insights into each step your data is processed by enroute to the destination, with an emphasis on the steps where data can be discarded due to errors or your filter preferences. Each step provides details into counts, change rates, and event details (like the associated Event Type or Event Names), and the discard steps (Failed on ingest, Filtered at source, Filtered at destination, & Failed delivery) provide you with the reasons events were dropped before reaching the destination. Discard steps also include how to control or alter that outcome, when possible. | ||
|
||
The pipeline view shows the following steps: | ||
- **Successfully received**: Events that Segment ingested from your source | ||
- **Failed on ingest**: Events that Segment received, but were dropped due to internal data validation rules | ||
- **Filtered at source**: Events that were discarded due to schema settings or [Protocols](/docs/protocols/) tracking plans | ||
- **Filtered at destination**: Events that were discarded due to [Destination Filters](/docs/guides/filtering-data/#destination-filters), [filtering in the Integrations object](/docs/guides/filtering-data/#filtering-with-the-integrations-object), or [per source schema integration filters](/docs/guides/filtering-data/#per-source-schema-integrations-filters). Actions destinations also have a filtering capability: for example, if your action is set to only send Identify events, all other event types will be filtered out. | ||
- **Failed delivery**: Events that have been discarded due to errors or unmet destination requirements | ||
- **Successful delivery**: Events that were successfully delivered to the destination | ||
|
||
### Breakdown table | ||
The breakdown table provides you with greater detail about the selected events. | ||
|
||
To open the breakdown table, select either the first step in the pipeline view (successfully received,) the last step in the pipeline view (successful delivery,) or select a discard step and then click on a discard reason. | ||
|
||
The breakdown table displays the following details: | ||
- **Event type**: The Segment spec event type (Track call vs. Identify call, for example) | ||
- **Event name**: The event name, provided by you or the source (*not available for inspection at all steps*) | ||
- **App version**: The app/release version, provided by you or the source (*not available for inspection at all steps*) | ||
- **Event count**: How many of each event either successfully made it through this pipeline step (in the case of the first or last steps in the pipeline view) or were filtered out (if you access it from a discard table) | ||
- **% Change**: Insight into how the event counts differ from the last comparable time range as a percentage<sup>1</sup> | ||
|
||
<sup>1:</sup> *Segment calculates the related change percentage by subtracting the percent of events impacted in the previous time period from the percent of impacted events in the current time period. For example, if last week 15% of your events were filtered at a source, but this week, 22% of your events were filtered at a source, you would have a related change percentage of 7%.* | ||
|
||
### Discard table | ||
The discard table provides you with greater detail about the events that failed to deliver or were filtered out of your sources and destinations. | ||
|
||
To open the discard table, click on one of the discard steps. If you click on a row in the discard table, you can see the breakdown table for the discarded events. | ||
|
||
The discard table displays the following details: | ||
- **Discard reason**: Any relevant error code, message, or description associated with the event's failure. When possible, Delivery Overview will link to any troubleshooting information you can use to get your events up and running again. Clicking on a discard reason brings you to the [breakdown table](#breakdown-table,) where you can see more detail about discarded events. | ||
- **Details & Samples**: View up to ten samples over the selected time range. Examine the error message and reason for the error or discard and inspect the payloads involved with the attempted transaction (*not available for inspection at all steps*) | ||
- **Event count**: How many of each event were discarded in this pipeline step | ||
- **% Change**: Insight into how the event counts differ from the last comparable time range as a percentage<sup>1</sup> | ||
|
||
<sup>1:</sup> *Segment calculates the related change percentage by subtracting the percent of events impacted in the previous time period from the percent of impacted events in the current time period. For example, if last week 15% of your events were filtered at a source, but this week, 22% of your events were filtered at a source, you would have a related change percentage of 7%.* | ||
|
||
## When should I use Delivery Overview? | ||
Delivery Overview is useful to diagnose delivery errors in the following scenarios: | ||
- **When setting up a destination, tracking plan, or filter for the first time**: With Delivery Overview, you can verify that the data you're sending to a new destination, a new tracking plan, or a new filter arrives in your destination as expected. | ||
- **When data is missing from your destination**: The pipeline view can help you see where your data is getting "stuck" on the way to your destination, which can help you quickly diagnose and address problems in your data pipeline. | ||
- **When emission or delivery volume fluctuates out of expected norms**: Delivery Overview will highlight where the largest rate change(s) occurred and what events were associated with the change. | ||
|
||
## Where do I find Delivery Overview? | ||
To view the Delivery Overview page: | ||
1. Sign into Segment. | ||
2. From the homepage, navigate to **Connection** > **Destinations** and click on the destination you'd like to investigate. | ||
3. Select the **Delivery Overview** tab from the destination header. | ||
|
||
## How do I use Delivery Overview? | ||
To use Delivery Overview: | ||
|
||
1. Navigate to the destination you'd like to review, and select **Delivery Overview** from the destination header. | ||
2. On the **Delivery Overview** tab, select a time period from the time picker. <br/> ___Optional___: *Turn the metric toggle off if you'd like to see the quantity of events as counts instead of percentages. Delivery Overview shows percentages by default.* | ||
3. Select a success or discard step to view additional context about the events that passed through that step. | ||
|
||
## How does Delivery Overview differ from other Segment monitoring and observability products? | ||
With Source Debugger or Event Delivery, you can only verify that events are successfully making it from your source or to your destination. If events fail, you have to troubleshoot to see where in the pipeline your events are getting stuck. With Event Tester, you can verify that your event makes it from your source to your destination, but if the results aren't what you expected, you're stuck troubleshooting your source, filters, tracking plans, and destinations. | ||
|
||
With Delivery Overview, you can verify that your source receives your events, that any filters and tracking plans work as expected, and that events successfully make it to your destination. Any errors or unexpected behavior can be identified using the pipeline view, leading to quicker resolution. | ||
|
||
## How can I configure alerts? | ||
During the Delivery Overview beta, you can use the Event Delivery alerting features (Delivery Alerts) by selecting the **Alerts** tab in the destination header. | ||
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Loving these alt texts.