Skip to content

Add new test for quantization check#6

Open
boomermath wants to merge 1 commit intoPhotonVision:mainfrom
boomermath:check-quant-test
Open

Add new test for quantization check#6
boomermath wants to merge 1 commit intoPhotonVision:mainfrom
boomermath:check-quant-test

Conversation

@boomermath
Copy link
Copy Markdown

No description provided.

Copy link
Copy Markdown
Member

@samfreund samfreund left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

    memLeakTestIterations property not set or empty; skipping memory leak test.
    benchmarkIterations property not set or empty; skipping memory leak test.


[2] WARNING: Could not find ncvt for conv cost (op_id=0x163700000231, op_name: q::ConvLayer), defaulting to ncvt=1
[2] WARNING: Could not find stride for conv cost (op_id=0x163100000215, op_name: q::ConvLayer), defaulting to stride=1
[2] WARNING: Could not find stride for conv cost (op_id=0x163100000215, op_name: q::ConvLayer), defaulting to stride=1
[2] WARNING: Could not find ncvt for conv cost (op_id=0x163100000215, op_name: q::ConvLayer), defaulting to ncvt=1
[2] WARNING: Could not find stride for conv cost (op_id=0x15E50000034F, op_name: q::ConvLayer), defaulting to stride=1
[2] WARNING: Could not find stride for conv cost (op_id=0x15E50000034F, op_name: q::ConvLayer), defaulting to stride=1
[2] WARNING: Could not find ncvt for conv cost (op_id=0x15E50000034F, op_name: q::ConvLayer), defaulting to ncvt=1
[2] WARNING: here is axes_info.axes[0]: 3
[2] WARNING: here is axes_info.axes[0]: 3
[2] WARNING: Disabling in place concat 0x999800000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x999a00000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x999c00000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x999e00000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99a000000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99a200000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99a400000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99a600000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99a800000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99aa00000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99ac00000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99ae00000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99b000000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99b200000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99b400000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99b600000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99b800000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99ba00000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99bc00000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: Disabling in place concat 0x99be00000058 ... dim 3 of input 1 not a multiple of 32
[2] WARNING: First group considered for subgraph had more peak tcm than threshold: 1615872 > 1572864

====== DDR bandwidth summary ======
spill_bytes=1046528
fill_bytes=1046528
write_total_bytes=1110016
read_total_bytes=5912576

INFO: Modified graph with external delegate
INFO: TensorFlow Lite initialization completed successfully
INFO: Input tensor is quantized
/prj/qct/webtech_scratch20/mlg_user_admin/qaisw_source_repo/rel/qairt-2.34.0/release/snpe_src/avante-tools/prebuilt/dsp/hexagon-sdk-5.4.0/ipc/fastrpc/rpcmem/src/rpcmem_android.c:42:dummy call to rpcmem_deinit, rpcmem APIs will be used from libxdsprpc
INFO: Object Detection instance destroyed successfully
INFO: Loaded model file 'src/test/resources/yolov8nCocoNoQuant.tflite'
INFO: Created external delegate
INFO: Loaded external delegate
/prj/qct/webtech_scratch20/mlg_user_admin/qaisw_source_repo/rel/qairt-2.34.0/release/snpe_src/avante-tools/prebuilt/dsp/hexagon-sdk-5.4.0/ipc/fastrpc/rpcmem/src/rpcmem_android.c:38:dummy call to rpcmem_init, rpcmem APIs will be used from libxdsprpc
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SERROR: qnn_graph_finalize failed. Error 1002
ERROR: Node number 269 (TfLiteQnnDelegate) failed to prepare.
ERROR: Restored original execution plan after delegate application failure.
ocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1]  <E> The SocModel doesn't support FP16
[1] tcm_migration.cc:2088:ERROR:Operator named q::*InputSlice (0x102000000002) not sufficiently tiled to fit in TCM. Requires 3686400 bytes
[1] graph_prepare.cc:2879:ERROR:Graph prepare TCM Migration action failed
[1] graph_prepare.cc:2939:ERROR:Graph prepare failed during optimization with err: 17, Fatal Optimize
/prj/qct/webtech_scratch20/mlg_user_admin/qaisw_source_repo/rel/qairt-2.34.0/release/snpe_src/avante-tools/prebuilt/dsp/hexagon-sdk-5.4.0/ipc/fastrpc/rpcmem/src/rpcmem_android.c:42:dummy call to rpcmem_deinit, rpcmem APIs will be used from libxdsprpc

> Task :test FAILED

RubikTest > testQuantizationCheck() FAILED
    java.lang.RuntimeException at RubikTest.java:238

4 tests completed, 1 failed, 2 skipped

[Incubating] Problems report is available at: file:///home/ubuntu/rubik_jni/build/reports/problems/problems-report.html

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':test'.
> There were failing tests. See the report at: file:///home/ubuntu/rubik_jni/build/reports/tests/test/index.html

* Try:
> Run with --scan to get full insights.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.14.3/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 9s
22 actionable tasks: 2 executed, 20 up-to-date

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants