-
Notifications
You must be signed in to change notification settings - Fork 1.7k
Package update for .NET Framework TFMs #12267
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Open
gewarren
wants to merge
19
commits into
dotnet:main
Choose a base branch
from
gewarren:package-check-0127-chunked
base: main
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
+117,913
−184,395
Open
Changes from 1 commit
Commits
Show all changes
19 commits
Select commit
Hold shift + click to select a range
58f55f6
index files
gewarren e18ceca
System namespace
gewarren 595546a
MEAI
gewarren bf0aff3
System.Web*
gewarren 02aa6ff
System.ServiceModel*
gewarren 12059cc
System.Security*
gewarren 5179cb5
System.Reflection*
gewarren a7b9c70
System.Numerics.Tensors*
gewarren 412bd2e
M.E.C*
gewarren 3230e57
M.E.D*
gewarren f108ca8
M.E.F*
gewarren 94ede14
M.E.L*
gewarren d97611a
M.E.H*
gewarren d36b9e8
System.CommandLine*
gewarren cca9499
System.Formats*
gewarren 0b01f00
M.E*
gewarren d3ab18e
System.Buffers*
gewarren d031e85
everything else
gewarren 18a9bca
reset unwanted changes to Index and Range
gewarren File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
100 changes: 100 additions & 0 deletions
100
xml/Microsoft.Extensions.DataIngestion.Chunkers/DocumentTokenChunker.xml
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,100 @@ | ||
| <Type Name="DocumentTokenChunker" FullName="Microsoft.Extensions.DataIngestion.Chunkers.DocumentTokenChunker"> | ||
| <TypeSignature Language="C#" Value="public sealed class DocumentTokenChunker : Microsoft.Extensions.DataIngestion.IngestionChunker<string>" /> | ||
| <TypeSignature Language="ILAsm" Value=".class public auto ansi sealed beforefieldinit DocumentTokenChunker extends Microsoft.Extensions.DataIngestion.IngestionChunker`1<string>" /> | ||
| <TypeSignature Language="DocId" Value="T:Microsoft.Extensions.DataIngestion.Chunkers.DocumentTokenChunker" /> | ||
| <TypeSignature Language="VB.NET" Value="Public NotInheritable Class DocumentTokenChunker
Inherits IngestionChunker(Of String)" /> | ||
| <TypeSignature Language="F#" Value="type DocumentTokenChunker = class
 inherit IngestionChunker<string>" /> | ||
| <TypeSignature Language="C++ CLI" Value="public ref class DocumentTokenChunker sealed : Microsoft::Extensions::DataIngestion::IngestionChunker<System::String ^>" /> | ||
| <AssemblyInfo> | ||
| <AssemblyName>Microsoft.Extensions.DataIngestion</AssemblyName> | ||
| <AssemblyVersion>10.2.0.0</AssemblyVersion> | ||
| </AssemblyInfo> | ||
| <Base> | ||
| <BaseTypeName>Microsoft.Extensions.DataIngestion.IngestionChunker<System.String></BaseTypeName> | ||
| <BaseTypeArguments> | ||
| <BaseTypeArgument TypeParamName="!0">System.String</BaseTypeArgument> | ||
| </BaseTypeArguments> | ||
| </Base> | ||
| <Interfaces /> | ||
| <Attributes> | ||
| <Attribute FrameworkAlternate="net-10.0-pp;net-8.0-pp;net-9.0-pp"> | ||
| <AttributeName Language="C#">[System.Runtime.CompilerServices.Nullable(new System.Byte[] { 0, 1 })]</AttributeName> | ||
| <AttributeName Language="F#">[<System.Runtime.CompilerServices.Nullable(new System.Byte[] { 0, 1 })>]</AttributeName> | ||
| </Attribute> | ||
| </Attributes> | ||
| <Docs> | ||
| <summary> | ||
| Processes a document by tokenizing its content and dividing it into overlapping chunks of tokens. | ||
| </summary> | ||
| <remarks> | ||
| <para>This class uses a tokenizer to convert the document's content into tokens and then splits the | ||
| tokens into chunks of a specified size, with a configurable overlap between consecutive chunks.</para> | ||
| <para>Note that tables may be split mid-row.</para> | ||
| </remarks> | ||
| </Docs> | ||
| <Members> | ||
| <Member MemberName=".ctor"> | ||
| <MemberSignature Language="C#" Value="public DocumentTokenChunker (Microsoft.Extensions.DataIngestion.IngestionChunkerOptions options);" /> | ||
| <MemberSignature Language="ILAsm" Value=".method public hidebysig specialname rtspecialname instance void .ctor(class Microsoft.Extensions.DataIngestion.IngestionChunkerOptions options) cil managed" /> | ||
| <MemberSignature Language="DocId" Value="M:Microsoft.Extensions.DataIngestion.Chunkers.DocumentTokenChunker.#ctor(Microsoft.Extensions.DataIngestion.IngestionChunkerOptions)" /> | ||
| <MemberSignature Language="VB.NET" Value="Public Sub New (options As IngestionChunkerOptions)" /> | ||
| <MemberSignature Language="F#" Value="new Microsoft.Extensions.DataIngestion.Chunkers.DocumentTokenChunker : Microsoft.Extensions.DataIngestion.IngestionChunkerOptions -> Microsoft.Extensions.DataIngestion.Chunkers.DocumentTokenChunker" Usage="new Microsoft.Extensions.DataIngestion.Chunkers.DocumentTokenChunker options" /> | ||
| <MemberSignature Language="C++ CLI" Value="public:
 DocumentTokenChunker(Microsoft::Extensions::DataIngestion::IngestionChunkerOptions ^ options);" /> | ||
| <MemberType>Constructor</MemberType> | ||
| <AssemblyInfo> | ||
| <AssemblyName>Microsoft.Extensions.DataIngestion</AssemblyName> | ||
| <AssemblyVersion>10.2.0.0</AssemblyVersion> | ||
| </AssemblyInfo> | ||
| <Parameters> | ||
| <Parameter Name="options" Type="Microsoft.Extensions.DataIngestion.IngestionChunkerOptions" /> | ||
| </Parameters> | ||
| <Docs> | ||
| <param name="options">The options used to configure the chunker, including tokenizer and chunk sizes.</param> | ||
| <summary> | ||
| Initializes a new instance of the <see cref="T:Microsoft.Extensions.DataIngestion.Chunkers.DocumentTokenChunker" /> class with the specified options. | ||
| </summary> | ||
| <remarks>To be added.</remarks> | ||
| </Docs> | ||
| </Member> | ||
| <Member MemberName="ProcessAsync"> | ||
| <MemberSignature Language="C#" Value="public override System.Collections.Generic.IAsyncEnumerable<Microsoft.Extensions.DataIngestion.IngestionChunk<string>> ProcessAsync (Microsoft.Extensions.DataIngestion.IngestionDocument document, System.Threading.CancellationToken cancellationToken = default);" /> | ||
| <MemberSignature Language="ILAsm" Value=".method public hidebysig virtual instance class System.Collections.Generic.IAsyncEnumerable`1<class Microsoft.Extensions.DataIngestion.IngestionChunk`1<string>> ProcessAsync(class Microsoft.Extensions.DataIngestion.IngestionDocument document, valuetype System.Threading.CancellationToken cancellationToken) cil managed" /> | ||
| <MemberSignature Language="DocId" Value="M:Microsoft.Extensions.DataIngestion.Chunkers.DocumentTokenChunker.ProcessAsync(Microsoft.Extensions.DataIngestion.IngestionDocument,System.Threading.CancellationToken)" /> | ||
| <MemberSignature Language="VB.NET" Value="Public Overrides Function ProcessAsync (document As IngestionDocument, Optional cancellationToken As CancellationToken = Nothing) As IAsyncEnumerable(Of IngestionChunk(Of String))" /> | ||
| <MemberSignature Language="F#" Value="override this.ProcessAsync : Microsoft.Extensions.DataIngestion.IngestionDocument * System.Threading.CancellationToken -> System.Collections.Generic.IAsyncEnumerable<Microsoft.Extensions.DataIngestion.IngestionChunk<string>>" Usage="documentTokenChunker.ProcessAsync (document, cancellationToken)" /> | ||
| <MemberType>Method</MemberType> | ||
| <AssemblyInfo> | ||
| <AssemblyName>Microsoft.Extensions.DataIngestion</AssemblyName> | ||
| <AssemblyVersion>10.2.0.0</AssemblyVersion> | ||
| </AssemblyInfo> | ||
| <Attributes> | ||
| <Attribute> | ||
| <AttributeName Language="C#">[System.Runtime.CompilerServices.AsyncIteratorStateMachine(typeof(Microsoft.Extensions.DataIngestion.Chunkers.DocumentTokenChunker+<ProcessAsync>d__4))]</AttributeName> | ||
| <AttributeName Language="F#">[<System.Runtime.CompilerServices.AsyncIteratorStateMachine(typeof(Microsoft.Extensions.DataIngestion.Chunkers.DocumentTokenChunker+<ProcessAsync>d__4))>]</AttributeName> | ||
| </Attribute> | ||
| </Attributes> | ||
| <ReturnValue> | ||
| <ReturnType>System.Collections.Generic.IAsyncEnumerable<Microsoft.Extensions.DataIngestion.IngestionChunk<System.String>></ReturnType> | ||
| </ReturnValue> | ||
| <Parameters> | ||
| <Parameter Name="document" Type="Microsoft.Extensions.DataIngestion.IngestionDocument" /> | ||
| <Parameter Name="cancellationToken" Type="System.Threading.CancellationToken"> | ||
| <Attributes> | ||
| <Attribute> | ||
| <AttributeName Language="C#">[System.Runtime.CompilerServices.EnumeratorCancellation]</AttributeName> | ||
| <AttributeName Language="F#">[<System.Runtime.CompilerServices.EnumeratorCancellation>]</AttributeName> | ||
| </Attribute> | ||
| </Attributes> | ||
| </Parameter> | ||
| </Parameters> | ||
| <Docs> | ||
| <param name="document">To be added.</param> | ||
| <param name="cancellationToken">To be added.</param> | ||
| <summary>To be added.</summary> | ||
| <returns>To be added.</returns> | ||
| <remarks>To be added.</remarks> | ||
| <inheritdoc /> | ||
| </Docs> | ||
| </Member> | ||
| </Members> | ||
| </Type> |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.