8000 AccessViolationException when running Microsoft.ML.Scenarios.ScenariosTests.TestRegressionScenario · Issue #6960 · dotnet/machinelearning · GitHub
[go: up one dir, main page]

Skip to content
8000

AccessViolationException when running Microsoft.ML.Scenarios.ScenariosTests.TestRegressionScenario #6960

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
michaelgsharp opened this issue Jan 17, 2024 · 0 comments
Labels
blocking-clean-ci Blocking PR or rolling builds Known Build Error Use this to report build issues in the .NET Helix tab

Comments

@michaelgsharp
Copy link
Contributor
michaelgsharp commented Jan 17, 2024

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=529419
Build error leg or test failing: Microsoft.ML.Tests.WorkItemExecution
Pull request: #6954

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "Microsoft.ML.Trainers.SdcaTrainerBase`3.TrainWithoutLock",
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Test is failing with the following exception.
https://helixre107v0xdeko0k025g8.blob.core.windows.net/dotnet-machinelearning-refs-pull-6954-merge-cc648714fbed40e1bb/Microsoft.ML.Tests/1/console.34966131.log?helixlogtype=result

Starting test: Microsoft.ML.Scenarios.ScenariosTests.TestRegressionScenario

Unhandled Exception: System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt.
   at System.Numerics.Tensors.TensorPrimitives.<Aggregate>g__Vectorized|53_1[TBinaryOperator,TAggregationOperator](Single& xRef, Single& yRef, UIntPtr remainder, TBinaryOperator binaryOp, TAggregationOperator aggregationOp)
   at System.Numerics.Tensors.TensorPrimitives.Aggregate[TBinaryOperator,TAggregationOperator](ReadOnlySpan`1 x, ReadOnlySpan`1 y, TBinaryOperator binaryOp, TAggregationOperator aggregationOp)
   at System.Numerics.Tensors.TensorPrimitives.Dot(ReadOnlySpan`1 x, ReadOnlySpan`1 y)
   at Microsoft.ML.Internal.CpuMath.CpuMathUtils.DotProductDense(ReadOnlySpan`1 left, ReadOnlySpan`1 right, Int32 count) in D:\a\_work\1\s\src\Microsoft.ML.CpuMath\CpuMathUtils.cs:line 194
   at Microsoft.ML.Numeric.VectorUtils.DotProduct(VBuffer`1& a, VBuffer`1& b) in D:\a\_work\1\s\src\Microsoft.ML.Data\Depricated\Vector\VectorUtils.cs:line 53
   at Microsoft.ML.Trainers.SdcaTrainerBase`3.WDot(VBuffer`1& features, VBuffer`1& weights, Single bias) in D:\a\_work\1\s\src\Microsoft.ML.StandardTrainers\Standard\SdcaBinary.cs:line 319
   at Microsoft.ML.Trainers.SdcaTrainerBase`3.TrainWithoutLock(IProgressChannelProvider progress, Factory cursorFactory, Random rand, IdToIdxLookup idToIdx, Int32 numThreads, DualsTableBase duals, Single[] biasReg, Single[] invariants, Single lambdaNInv, VBuffer`1[] weights, Single[] biasUnreg, VBuffer`1[] l1IntermediateWeights, Single[] l1IntermediateBias, Single[] featureNormSquared) in D:\a\_work\1\s\src\Microsoft.ML.StandardTrainers\Standard\SdcaBinary.cs:line 839
   at Microsoft.ML.Trainers.SdcaTrainerBase`3.<>c__DisplayClass13_3.<TrainCore>b__5(Int32 j) in D:\a\_work\1\s\src\Microsoft.ML.StandardTrainers\Standard\SdcaBinary.cs:line 639
   at System.Threading.Tasks.Parallel.<>c__DisplayClass17_0`1.<ForWorker>b__1()
   at System.Threading.Tasks.Task.InnerInvokeWithArg(Task childTask)
   at System.Threading.Tasks.Task.<>c__DisplayClass176_0.<ExecuteSelfReplicating>b__0(Object )
   at System.Threading.Tasks.Task.Execute()
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.Tasks.Task.ExecuteWithThreadLocal(Task& currentTaskSlot)
   at System.Threading.Tasks.Task.ExecuteEntry(Boolean bPreventDoubleExecution)
   at System.Threading.ThreadPoolWorkQueue.Dispatch()

Report

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
0 0 0
@michaelgsharp michaelgsharp added blocking-clean-ci Blocking PR or rolling builds Known Build Error Use this to report build issues in the .NET Helix tab labels Jan 17, 2024
@ghost ghost added the untriaged New issue has not been triaged label Jan 17, 2024
@michaelgsharp michaelgsharp removed the untriaged New issue has not been triaged label Jan 23, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
blocking-clean-ci Blocking PR or rolling builds Known Build Error Use this to report build issues in the .NET Helix tab
Projects
None yet
Development

No branches or pull requests

1 participant
0