Thanks to visit codestin.com
Credit goes to github.com

Skip to content

Delivery Overview Public Beta [DOC-655] #4594

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 28 commits into from
May 23, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
928402b
init delivery overview page, sidenav
forstisabella Feb 9, 2023
8449169
sp
forstisabella Feb 9, 2023
404aeca
ROUGH draft of content
forstisabella Feb 17, 2023
e05f49c
Merge branch 'develop' into DOC-655-IG
forstisabella Feb 17, 2023
940a2ed
Update delivery-overview.md
forstisabella Feb 21, 2023
dcc9384
Merge branch 'develop' into DOC-655-IG
forstisabella Feb 22, 2023
5c1e5cf
more context about how to use/filter delivery overview
forstisabella Feb 23, 2023
15b2f12
Update delivery-overview.md
forstisabella Feb 23, 2023
d6912d8
ROUGH draft of DO docs, event tester fixes
forstisabella Feb 24, 2023
0d3b811
Merge branch 'develop' into DOC-655-IG
forstisabella Feb 24, 2023
6280942
editing pass/matching the terms in the ui
forstisabella Feb 24, 2023
8b97800
Source debugger/event tester fixes
forstisabella Feb 24, 2023
37936ef
Update delivery-overview.md
forstisabella Feb 24, 2023
643aaf2
[netlify-build]
forstisabella Feb 24, 2023
ebf3d52
Merge branch 'develop' into DOC-655-IG
forstisabella Feb 28, 2023
231635f
Making requested changes [netlify-build]
forstisabella Mar 3, 2023
ab3bc8e
Merge branch 'develop' into DOC-655-IG
forstisabella Mar 3, 2023
38ebbf0
changes requested by Peter, Eric
forstisabella Mar 20, 2023
6ad8fc4
Merge branch 'develop' into DOC-655-IG
forstisabella Mar 20, 2023
80a5f79
Add to beta callout about the incremental release
forstisabella Apr 17, 2023
08536f3
Merge branch 'develop' into DOC-655-IG
forstisabella Apr 17, 2023
27f0bfc
Merge branch 'develop' into DOC-655-IG
forstisabella Apr 17, 2023
564b1ce
[netlify-build]
forstisabella Apr 18, 2023
42ae275
Apply suggestions from code review
forstisabella Apr 18, 2023
404163d
Merge branch 'develop' into DOC-655-IG
forstisabella Apr 18, 2023
a93f8ba
removing "currently", date
forstisabella Apr 18, 2023
4c81cbe
Merge branch 'develop' into DOC-655-IG
forstisabella May 19, 2023
2476983
Editing phased rollout language
forstisabella May 22, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions src/_data/sidenav/main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -253,6 +253,8 @@ sections:
title: Using Schema Controls
- path: /connections/event-delivery
title: Event Delivery
- path: /connections/delivery-overview
title: Delivery Overview
- path: /connections/find-writekey
title: Locate Your Write Key
- path: /connections/integration_error_codes
Expand Down
85 changes: 85 additions & 0 deletions src/connections/delivery-overview.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,85 @@
---
title: Delivery Overview
---

Delivery Overview is a visual observability tool designed to help Segment users diagnose event delivery issues for any cloud-streaming destination receiving events from cloud-streaming sources.

> info "Delivery Overview is currently in beta"
> This means that the Delivery Overview feature is in active development, and some functionality may change before it becomes generally available. Beta users of Delivery Overview will still have access to the Event Delivery tab. During the public beta, Delivery Overview will only support event-streaming, cloud-mode destinations.
>
> The Delivery Overview public beta will be released to all Segment users on May 23, 2023 in a phased rollout. Users can expect to see the Delivery Overview tab in their destination details page by 5 PM PDT on May 26, 2023.

## Key features

Delivery Overview has three core features:
- [Pipeline view](#pipeline-view): a visual overview of each step your data takes during the delivery process
- [Breakdown table](#breakdown-table): contains more detail about the events that were processed at each pipeline step
- [Discard table](#discard-table): contains details about the events that failed or were filtered out of your process and allows you to inspect samples of them

You can refine these tables using the time picker and the metric toggle, located under the destination header. With the time picker, you can specify a time period (last 10 minutes, 1 hour, 24 hours, or 7 days) for which you'd like to see data. With the metric toggle, you can switch between seeing metrics represented as percentages (for example, *85% of events* or *a 133% increase in events*) or as counts (*13 events* or *an increase of 145 events*.) Delivery Overview shows percentages by default.

### Pipeline view
The pipeline view provides insights into each step your data is processed by enroute to the destination, with an emphasis on the steps where data can be discarded due to errors or your filter preferences. Each step provides details into counts, change rates, and event details (like the associated Event Type or Event Names), and the discard steps (Failed on ingest, Filtered at source, Filtered at destination, & Failed delivery) provide you with the reasons events were dropped before reaching the destination. Discard steps also include how to control or alter that outcome, when possible.

The pipeline view shows the following steps:
- **Successfully received**: Events that Segment ingested from your source
- **Failed on ingest**: Events that Segment received, but were dropped due to internal data validation rules
- **Filtered at source**: Events that were discarded due to schema settings or [Protocols](/docs/protocols/) tracking plans
- **Filtered at destination**: Events that were discarded due to [Destination Filters](/docs/guides/filtering-data/#destination-filters), [filtering in the Integrations object](/docs/guides/filtering-data/#filtering-with-the-integrations-object), or [per source schema integration filters](/docs/guides/filtering-data/#per-source-schema-integrations-filters). Actions destinations also have a filtering capability: for example, if your action is set to only send Identify events, all other event types will be filtered out.
- **Failed delivery**: Events that have been discarded due to errors or unmet destination requirements
- **Successful delivery**: Events that were successfully delivered to the destination

### Breakdown table
The breakdown table provides you with greater detail about the selected events.

To open the breakdown table, select either the first step in the pipeline view (successfully received,) the last step in the pipeline view (successful delivery,) or select a discard step and then click on a discard reason.

The breakdown table displays the following details:
- **Event type**: The Segment spec event type (Track call vs. Identify call, for example)
- **Event name**: The event name, provided by you or the source (*not available for inspection at all steps*)
- **App version**: The app/release version, provided by you or the source (*not available for inspection at all steps*)
- **Event count**: How many of each event either successfully made it through this pipeline step (in the case of the first or last steps in the pipeline view) or were filtered out (if you access it from a discard table)
- **% Change**: Insight into how the event counts differ from the last comparable time range as a percentage<sup>1</sup>

<sup>1:</sup> *Segment calculates the related change percentage by subtracting the percent of events impacted in the previous time period from the percent of impacted events in the current time period. For example, if last week 15% of your events were filtered at a source, but this week, 22% of your events were filtered at a source, you would have a related change percentage of 7%.*

### Discard table
The discard table provides you with greater detail about the events that failed to deliver or were filtered out of your sources and destinations.

To open the discard table, click on one of the discard steps. If you click on a row in the discard table, you can see the breakdown table for the discarded events.

The discard table displays the following details:
- **Discard reason**: Any relevant error code, message, or description associated with the event's failure. When possible, Delivery Overview will link to any troubleshooting information you can use to get your events up and running again. Clicking on a discard reason brings you to the [breakdown table](#breakdown-table,) where you can see more detail about discarded events.
- **Details & Samples**: View up to ten samples over the selected time range. Examine the error message and reason for the error or discard and inspect the payloads involved with the attempted transaction (*not available for inspection at all steps*)
- **Event count**: How many of each event were discarded in this pipeline step
- **% Change**: Insight into how the event counts differ from the last comparable time range as a percentage<sup>1</sup>

<sup>1:</sup> *Segment calculates the related change percentage by subtracting the percent of events impacted in the previous time period from the percent of impacted events in the current time period. For example, if last week 15% of your events were filtered at a source, but this week, 22% of your events were filtered at a source, you would have a related change percentage of 7%.*

## When should I use Delivery Overview?
Delivery Overview is useful to diagnose delivery errors in the following scenarios:
- **When setting up a destination, tracking plan, or filter for the first time**: With Delivery Overview, you can verify that the data you're sending to a new destination, a new tracking plan, or a new filter arrives in your destination as expected.
- **When data is missing from your destination**: The pipeline view can help you see where your data is getting "stuck" on the way to your destination, which can help you quickly diagnose and address problems in your data pipeline.
- **When emission or delivery volume fluctuates out of expected norms**: Delivery Overview will highlight where the largest rate change(s) occurred and what events were associated with the change.

## Where do I find Delivery Overview?
To view the Delivery Overview page:
1. Sign into Segment.
2. From the homepage, navigate to **Connection** > **Destinations** and click on the destination you'd like to investigate.
3. Select the **Delivery Overview** tab from the destination header.

## How do I use Delivery Overview?
To use Delivery Overview:

1. Navigate to the destination you'd like to review, and select **Delivery Overview** from the destination header.
2. On the **Delivery Overview** tab, select a time period from the time picker. <br/> ___Optional___: *Turn the metric toggle off if you'd like to see the quantity of events as counts instead of percentages. Delivery Overview shows percentages by default.*
3. Select a success or discard step to view additional context about the events that passed through that step.

## How does Delivery Overview differ from other Segment monitoring and observability products?
With Source Debugger or Event Delivery, you can only verify that events are successfully making it from your source or to your destination. If events fail, you have to troubleshoot to see where in the pipeline your events are getting stuck. With Event Tester, you can verify that your event makes it from your source to your destination, but if the results aren't what you expected, you're stuck troubleshooting your source, filters, tracking plans, and destinations.

With Delivery Overview, you can verify that your source receives your events, that any filters and tracking plans work as expected, and that events successfully make it to your destination. Any errors or unexpected behavior can be identified using the pipeline view, leading to quicker resolution.

## How can I configure alerts?
During the Delivery Overview beta, you can use the Event Delivery alerting features (Delivery Alerts) by selecting the **Alerts** tab in the destination header.

2 changes: 1 addition & 1 deletion src/connections/sources/debugger.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ The Source Debugger is a real-time tool that helps you confirm that API calls ma

The Debugger is separate from your workspace's data pipeline and is not an exhaustive view of all the events ever sent to your Segment workspace. The Debugger only shows a sample of the events that the Source receives in real time, with a cap of 500 events. The Debugger is a great way to test specific parts of your implementation to validate that events are being fired successfully and arriving to your Source.

To see a more complete view of all your events, we recommend that you set up either a [warehouse](/docs/connections/storage/warehouses/) or an [S3 destination](/docs/connections/destinations/catalog/amazon-s3/).
To see a more complete view of all your events, Segment recommends that you set up a [warehouse](/docs/connections/storage/warehouses/) or an [S3 destination](/docs/connections/destinations/catalog/aws-s3/).

The Debugger shows a live stream of sampled events arriving into the Source, but you can also pause the stream from displaying new events by toggling "Live" to "Pause". Events continue to arrive to your Source while you Pause the stream.

Expand Down
14 changes: 7 additions & 7 deletions src/connections/test-connections.md
Original file line number Diff line number Diff line change
Expand Up @@ -25,13 +25,13 @@ Go to your Source Debugger, select an event and in the top right hand side of th

Select the destination that you want to test this event with. At this time, you can only use the Event Tester for cloud-mode (server side) destinations.

![Screenshot of the Select the Destination you want to validate the event in popup. No destination has been selected on the popup.](images/event-tester_2JfoKddf.png)
![A screenshot of the destination selection pop up modal](images/event-tester_2JfoKddf.png)

**3. Send event to destination**

The event payload from your debugger that you just selected will automatically load in the JSON view. You have the option to edit the payload if you want. Assuming it looks good, select "Send Event" at the bottom right of the screen. 

![Screenshot of the Event Tester page.](images/event-tester_J7TEDYvY.png)
![A screenshot of the Event Tester, with a track event selected](images/event-tester_J7TEDYvY.png)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Loving these alt texts.


**4. Ensure you're happy to send the test event to the destination**

Expand All @@ -41,18 +41,18 @@ This is a real event that will appear in your end tool alongside your existing d

**5. View the Partner API response**

On the right hand side of the Event Tester you will see the response from the partner API. At the top, we provide of summary of the response. Below is the raw response payload we received that you can use for further debugging if necessary. 
On the right hand side of the Event Tester you will see the response from the partner API. At the top, Segment provide of summary of the response. Below is the raw response payload Segment received that you can use for further debugging if necessary. 

![Screenshot of the Event Tester page, with the Response from Destination tab selected.](images/event-tester_il6mvexS.png)
![A screenshot of the Event Tester with a successful response from the destination](images/event-tester_il6mvexS.png)

If you are receiving an error and are unsure how to fix the issue, visit the partner docs (e.g. [https://developers.google.com/analytics/devguides/reporting/core/v3/errors](https://developers.google.com/analytics/devguides/reporting/core/v3/errors)) or contact the partner support team. 
If you are receiving an error and are unsure how to fix the issue, visit the partner docs (for example [https://developers.google.com/analytics/devguides/reporting/core/v3/errors](https://developers.google.com/analytics/devguides/reporting/core/v3/errors){:target="_blank”}) or contact the partner support team. 

# FAQ
## FAQ

**Why can't I see the Event Tester when I log into my workspace?**

The Event Tester is only accessible to users with write access in their Segment workspace (read-only users will not see the Event Tester in their workspace). 

**The Event Tester experienced an error when sending my event. Why did this happen?**

If you experience an error, [let us know](https://segment.com/help/contact/) and we'll help you troubleshoot the issue.
If you experience an error, [let Segment know](mailto:friends@segment.com) and the Segment team will help you troubleshoot the issue.