feat: Native Speculative Decoding & MTP (Multi-Token Prediction) - #1431
Open
zsogitbe wants to merge 3 commits into
Open
feat: Native Speculative Decoding & MTP (Multi-Token Prediction)#1431zsogitbe wants to merge 3 commits into
zsogitbe wants to merge 3 commits into
Annotations
1 error and 11 warnings
|
Test
Process completed with exit code 1.
|
|
Complete job
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/cache@v4, actions/setup-dotnet@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
Build:
LLama/LLamaInteractExecutor.cs#L131
Parameter 'cancellationToken' has no matching param tag in the XML comment for 'InteractiveExecutor.PreprocessInputs(string?, StatefulExecutorBase.InferStateArgs, CancellationToken)' (but other parameters do)
|
|
Build:
LLama/LLamaInteractExecutor.cs#L121
Parameter 'cancellationToken' has no matching param tag in the XML comment for 'InteractiveExecutor.GetLoopCondition(StatefulExecutorBase.InferStateArgs, CancellationToken)' (but other parameters do)
|
|
Build:
LLama/LLamaInstructExecutor.cs#L50
Missing XML comment for publicly visible type or member 'InstructExecutor.InstructExecutor(LLamaContext, MtmdWeights, string, string, ILogger?)'
|
|
Build:
LLama/Extensions/IntPtrExtensions.cs#L7
Missing XML comment for publicly visible type or member 'IntPtrExtensions'
|
|
Build:
LLama/Batched/Conversation.cs#L826
Missing XML comment for publicly visible type or member 'Conversation.DequeueSpeculativeToken()'
|
|
Build:
LLama/Batched/Conversation.cs#L263
Missing XML comment for publicly visible type or member 'Conversation.Prompt(string, bool, bool)'
|
|
Build:
LLama/Batched/Conversation.cs#L34
Missing XML comment for publicly visible type or member 'Conversation.HasSpeculativeTokens'
|
|
Build:
LLama/LLamaInteractExecutor.cs#L30
The field 'InteractiveExecutor._mtmdMarker' is never used
|
|
Build:
LLama/LLamaInteractExecutor.cs#L29
The field 'InteractiveExecutor._mtmdChunks' is never used
|
|
Build:
LLama/Extensions/IModelParamsExtensions.cs#L126
Possible null reference argument for parameter 'key' in 'IntPtr Dictionary<string, IntPtr>.this[string key]'.
|
background
wait
wait-all
cancel
parallel
Loading