You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/search/search-api-preview.md
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -24,7 +24,7 @@ Preview features that transition to general availability are removed from this l
24
24
|[**Management REST API 2021-04-01-Preview**](/rest/api/searchmanagement/)| Security | Modifies [Create or Update Service](/rest/api/searchmanagement/2021-04-01-preview/services/create-or-update) to support new [DataPlaneAuthOptions](/rest/api/searchmanagement/2021-04-01-preview/services/create-or-update#dataplaneauthoptions). | Public preview, [Management REST API](/rest/api/searchmanagement/), API version 2021-04-01-Preview. Announced in May 2021. |
25
25
|[**Reset Documents**](search-howto-run-reset-indexers.md)| Indexer | Reprocesses individually selected search documents in indexer workloads. | Use the [Reset Documents REST API](/rest/api/searchservice/preview-api/reset-documents), API versions 2021-04-30-Preview or 2020-06-30-Preview. |
26
26
|[**Power Query connectors**](search-how-to-index-power-query-data-sources.md)| Indexer data source | Indexers can now index from other cloud platforms. If you are using an indexer to crawl external data sources for indexing, you can now use Power Query connectors to connect to Amazon Redshift, Elasticsearch, PostgreSQL, Salesforce Objects, Salesforce Reports, Smartsheet, and Snowflake. |[Sign up](https://aka.ms/azure-cognitive-search/indexer-preview) is required so that support can be enabled for your subscription on the backend. Configure this data source using [Create or Update Data Source](/rest/api/searchservice/preview-api/create-or-update-data-source), API versions 2021-04-30-Preview or 2020-06-30-Preview, or the Azure portal.|
27
-
|[**SharePoint Online Indexer**](search-howto-index-sharepoint-online.md)| Indexer data source | New data source for indexer-based indexing of SharePoint content. |[Sign up](https://aka.ms/azure-cognitive-search/indexer-preview) is required so that support can be enabled for your subscription on the backend. Configure this data source using [Create or Update Data Source](/rest/api/searchservice/preview-api/create-or-update-data-source), API versions 2021-04-30-Preview or 2020-06-30-Preview, or the Azure portal. |
27
+
|[**SharePoint Indexer**](search-howto-index-sharepoint-online.md)| Indexer data source | New data source for indexer-based indexing of SharePoint content. |[Sign up](https://aka.ms/azure-cognitive-search/indexer-preview) is required so that support can be enabled for your subscription on the backend. Configure this data source using [Create or Update Data Source](/rest/api/searchservice/preview-api/create-or-update-data-source), API versions 2021-04-30-Preview or 2020-06-30-Preview, or the Azure portal. |
28
28
|[**MySQL indexer data source**](search-howto-index-mysql.md)| Indexer data source | Index content and metadata from Azure MySQL data sources.|[Sign up](https://aka.ms/azure-cognitive-search/indexer-preview) is required so that support can be enabled for your subscription on the backend. Configure this data source using [Create or Update Data Source](/rest/api/searchservice/preview-api/create-or-update-data-source), API versions 2021-04-30-Preview or 2020-06-30-Preview, [.NET SDK 11.2.1](/dotnet/api/azure.search.documents.indexes.models.searchindexerdatasourcetype.mysql), and Azure portal. |
29
29
|[**Cosmos DB indexer: MongoDB API, Gremlin API**](search-howto-index-cosmosdb.md)| Indexer data source | For Cosmos DB, SQL API is generally available, but MongoDB and Gremlin APIs are in preview. | For MongoDB and Gremlin, [sign up first](https://aka.ms/azure-cognitive-search/indexer-preview) so that support can be enabled for your subscription on the backend. MongoDB data sources can be configured in the portal. Configure this data source using [Create or Update Data Source](/rest/api/searchservice/preview-api/create-or-update-data-source), API versions 2021-04-30-Preview or 2020-06-30-Preview. |
30
30
|[**Native blob soft delete**](search-howto-index-changed-deleted-blobs.md)| Indexer data source | The Azure Blob Storage indexer in Azure Cognitive Search will recognize blobs that are in a soft deleted state, and remove the corresponding search document during indexing. | Configure this data source using [Create or Update Data Source](/rest/api/searchservice/preview-api/create-or-update-data-source), API versions 2021-04-30-Preview or 2020-06-30-Preview. |
Copy file name to clipboardExpand all lines: articles/search/search-blob-metadata-properties.md
+4-4Lines changed: 4 additions & 4 deletions
Original file line number
Diff line number
Diff line change
@@ -13,17 +13,17 @@ ms.date: 01/15/2022
13
13
14
14
# Content metadata properties used in Azure Cognitive Search
15
15
16
-
Several of the indexer-supported data sources, including Azure Blob Storage, Azure Data Lake Storage Gen2, and SharePoint Online, contain standalone files or embedded objects of various content types. Many of those content types have metadata properties that can be useful to index. Just as you can create search fields for standard blob properties like **`metadata_storage_name`**, you can create fields in a search index for metadata properties that are specific to a document format.
16
+
Several of the indexer-supported data sources, including Azure Blob Storage, Azure Data Lake Storage Gen2, and SharePoint, contain standalone files or embedded objects of various content types. Many of those content types have metadata properties that can be useful to index. Just as you can create search fields for standard blob properties like **`metadata_storage_name`**, you can create fields in a search index for metadata properties that are specific to a document format.
17
17
18
18
## Supported document formats
19
19
20
-
Cognitive Search supports blob indexing and SharePoint Online document indexing for the following document formats:
20
+
Cognitive Search supports blob indexing and SharePoint document indexing for the following document formats:
The following table summarizes processing done for each document format, and describes the metadata properties extracted by a blob indexer and the SharePoint Online indexer.
26
+
The following table summarizes processing done for each document format, and describes the metadata properties extracted by a blob indexer and the SharePoint indexer.
27
27
28
28
| Document format / content type | Extracted metadata | Processing details |
29
29
| --- | --- | --- |
@@ -60,4 +60,4 @@ The following table summarizes processing done for each document format, and des
60
60
*[Indexers in Azure Cognitive Search](search-indexer-overview.md)
Copy file name to clipboardExpand all lines: articles/search/search-data-sources-gallery.md
+7-7Lines changed: 7 additions & 7 deletions
Original file line number
Diff line number
Diff line change
@@ -183,11 +183,11 @@ Connect to Cosmos DB through the Mongo API to extract items from a container, se
183
183
184
184
---
185
185
186
-
### SharePoint Online
186
+
### SharePoint
187
187
188
188
by [Cognitive Search](search-what-is-azure-search.md)
189
189
190
-
Connect to a SharePoint Online site and index documents from one or more Document Libraries, for accounts and search services in the same tenant. Text and normalized images will be extracted by default. Optionally, you can configure a skillset for more content transformation and enrichment, or configure change tracking to refresh a search index with new or changed content in SharePoint.
190
+
Connect to a SharePoint site and index documents from one or more Document Libraries, for accounts and search services in the same tenant. Text and normalized images will be extracted by default. Optionally, you can configure a skillset for more content transformation and enrichment, or configure change tracking to refresh a search index with new or changed content in SharePoint.
@@ -831,7 +831,7 @@ The Database Server connector will crawl content from a Relational Database serv
831
831
832
832
by [BA Insight](https://www.bainsight.com/)
833
833
834
-
The Deltek Vision Connector honors the security of the source system and provides both full and incremental crawls, so users always have the latest information available to them. It indexes content from Deltek Vision into Azure, SharePoint Online, or SharePoint 2016/2013, surfacing it through BA Insight's SmartHub to provide users with integrated search results.
834
+
The Deltek Vision Connector honors the security of the source system and provides both full and incremental crawls, so users always have the latest information available to them. It indexes content from Deltek Vision into Azure, SharePoint in Microsoft 365, or SharePoint 2016/2013, surfacing it through BA Insight's SmartHub to provide users with integrated search results.
@@ -2451,11 +2451,11 @@ BA Insight's SharePoint Connector allows you to connect to SharePoint 2019, fetc
2451
2451
2452
2452
---
2453
2453
2454
-
### SharePoint Online
2454
+
### SharePoint in Microsoft 365
2455
2455
2456
2456
by [Accenture](https://www.accenture.com)
2457
2457
2458
-
The SharePoint Online connector will crawl content from any SharePoint Online site collection URL. The connector will retrieve Sites, Lists, Folders, List Items and Attachments, as well as other pages (in .aspx format). Supports SharePoint running in the Microsoft O365 offering.
2458
+
The SharePoint connector will crawl content from any SharePoint site collection URL. The connector will retrieve Sites, Lists, Folders, List Items and Attachments, as well as other pages (in .aspx format). Supports SharePoint running in the Microsoft O365 offering.
@@ -2475,11 +2475,11 @@ The SharePoint Online connector will crawl content from any SharePoint Online si
2475
2475
2476
2476
---
2477
2477
2478
-
### SharePoint Online
2478
+
### SharePoint in Microsoft 365
2479
2479
2480
2480
by [BA Insight](https://www.bainsight.com/)
2481
2481
2482
-
BA Insight's SharePoint Online Connector allows you to connect to SharePoint Online, fetch data from any site, document library, or list; and index this content securely.
2482
+
BA Insight's SharePoint Connector allows you to connect to SharePoint in Microsoft 365, fetch data from any site, document library, or list; and index this content securely.
Copy file name to clipboardExpand all lines: articles/search/search-howto-index-changed-deleted-blobs.md
+5-5Lines changed: 5 additions & 5 deletions
Original file line number
Diff line number
Diff line change
@@ -30,7 +30,7 @@ There are two ways to implement a soft delete strategy:
30
30
+ Use consistent document keys and file structure. Changing document keys or directory names and paths (applies to ADLS Gen2) breaks the internal tracking information used by indexers to know which content was indexed, and when it was last indexed.
31
31
32
32
> [!NOTE]
33
-
> ADLS Gen2 allows directories to be renamed. When a directory is renamed, the timestamps for the blobs in that directory do not get updated. As a result, the indexer will not reindex those blobs. If you need the blobs in a directory to be reindexed after a directory rename because they now have new URLs, you will need to update the `LastModified` timestamp for all the blobs in the directory so that the indexer knows to reindex them during a future run. The virtual directories in Azure Blob Storage cannot be changed, so they do not have this issue.
33
+
> ADLS Gen2 allows directories to be renamed. When a directory is renamed, the timestamps for the blobs in that directory do not get updated. As a result, the indexer will not re-index those blobs. If you need the blobs in a directory to be reindexed after a directory rename because they now have new URLs, you will need to update the `LastModified` timestamp for all the blobs in the directory so that the indexer knows to re-index them during a future run. The virtual directories in Azure Blob Storage cannot be changed, so they do not have this issue.
34
34
35
35
## Native blob soft delete (preview)
36
36
@@ -69,15 +69,15 @@ For this deletion detection approach, Cognitive Search depends on the [native bl
69
69
70
70
1. [Run the indexer](/rest/api/searchservice/run-indexer) or set the indexer to run [on a schedule](search-howto-schedule-indexers.md). When the indexer runs and processes a blob having a soft delete state, the corresponding search document will be removed from the index.
### Re-index un-deleted blobs using native soft delete policies
73
73
74
-
If you restore a soft deleted blob in Blob storage, the indexer will not always reindex it. This is because the indexer uses the blob's `LastModified` timestamp to determine whether indexing is needed. When a soft deleted blob is undeleted, its `LastModified` timestamp does not get updated, so if the indexer has already processed blobs with more recent `LastModified` timestamps, it won't reindex the undeleted blob.
74
+
If you restore a soft deleted blob in Blob storage, the indexer will not always re-index it. This is because the indexer uses the blob's `LastModified` timestamp to determine whether indexing is needed. When a soft deleted blob is undeleted, its `LastModified` timestamp does not get updated, so if the indexer has already processed blobs with more recent `LastModified` timestamps, it won't re-index the undeleted blob.
75
75
76
76
To make sure that an undeleted blob is reindexed, you will need to update the blob's `LastModified` timestamp. One way to do this is by resaving the metadata of that blob. You don't need to change the metadata, but resaving the metadata will update the blob's `LastModified` timestamp so that the indexer knows to pick it up.
77
77
78
78
<a name="soft-delete-using-custom-metadata"></a>
79
79
80
-
## Custom metadata: Soft delete strategy
80
+
## Soft delete strategy using custom metadata
81
81
82
82
This method uses custom metadata to indicate whether a search document should be removed from the index. It requires two separate actions: deleting the search document from the index, followed by file deletion in Azure Storage.
83
83
@@ -104,7 +104,7 @@ There are steps to follow in both Azure Storage and Cognitive Search, but there
104
104
105
105
1. Run the indexer. Once the indexer has processed the file and deleted the document from the search index, you can then delete the physical file in Azure Storage.
106
106
107
-
## Custom metadata: Re-index undeleted blobs and files
107
+
## Re-index un-deleted blobs and files
108
108
109
109
You can reverse a soft-delete if the original source file still physically exists in Azure Storage.
0 commit comments