Closed
Description
Describe the bug
I expect that the owner of tests can execute its tests successfully. And if this is not the case the tests should throw an appropriate exception (e.g. must be executed as ut3_tester_helper) or it should be disabled dynamically.
Provide version info
19.0.0.0.0
19.0.0
PL/SQL procedure successfully completed.
UT_VERSION
------------------------------------------------------------
v3.1.8.3142-develop
BANNER BANNER_FULL BANNER_LEGACY CON_ID
-------------------------------------------------------------------------------- ---------------------------------------------------------------------------------------------------------------------------------------------------------------- -------------------------------------------------------------------------------- ----------
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production 0
Version 19.2.0.0.0
PARAMETER VALUE
------------------------------ ----------------------------------------------------------------
NLS_LANGUAGE ENGLISH
NLS_TERRITORY SWITZERLAND
NLS_CURRENCY SFr.
NLS_ISO_CURRENCY SWITZERLAND
NLS_NUMERIC_CHARACTERS .'
NLS_CALENDAR GREGORIAN
NLS_DATE_FORMAT DD.MM.YYYY HH24:MI:SS
NLS_DATE_LANGUAGE ENGLISH
NLS_SORT BINARY
NLS_TIME_FORMAT HH24:MI:SSXFF
NLS_TIMESTAMP_FORMAT DD.MM.RR HH24:MI:SSXFF
PARAMETER VALUE
------------------------------ ----------------------------------------------------------------
NLS_TIME_TZ_FORMAT HH24:MI:SSXFF TZR
NLS_TIMESTAMP_TZ_FORMAT DD.MM.RR HH24:MI:SSXFF TZR
NLS_DUAL_CURRENCY SF
NLS_COMP BINARY
NLS_LENGTH_SEMANTICS BYTE
NLS_NCHAR_CONV_EXCP FALSE
17 rows selected.
PORT_STRING
------------------------------------------------------------
x86_64/Linux 2.4.xx
Information about client software
irrelevant.
To Reproduce
-
connect as user
ut3_testerin a current development environment -
run the the follwing:
SET SERVEROUTPUT ON SIZE UNLIMITED
EXECUTE ut.run('UT3_TESTER');
- Look at the output:
Failures:
1) after_each_executed
Actual: 3 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.AFTER_EACH_EXECUTED", line 160 ut.expect(l_test.result).to_equal(ut3.ut_utils.gc_success);
Actual: 0 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.AFTER_EACH_EXECUTED", line 161 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(1);
2) before_each_executed
Actual: 3 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.BEFORE_EACH_EXECUTED", line 332 ut.expect(l_test.result).to_equal(ut3.ut_utils.gc_success);
Actual: NULL (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.BEFORE_EACH_EXECUTED", line 333 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(1);
3) before_test_executed
Actual: 3 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.BEFORE_TEST_EXECUTED", line 536 ut.expect(l_test.result).to_equal(ut3.ut_utils.gc_success);
Actual: NULL (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.BEFORE_TEST_EXECUTED", line 537 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(1);
4) after_test_executed
Actual: 3 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.AFTER_TEST_EXECUTED", line 591 ut.expect(l_test.result).to_equal(ut3.ut_utils.gc_success);
Actual: 0 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.AFTER_TEST_EXECUTED", line 592 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(1);
5) disabled_test
Actual: NULL (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.DISABLED_TEST", line 25 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(1);
Actual: 3 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.DISABLED_TEST", line 26 ut.expect(l_suite.result).to_equal(ut3.ut_utils.gc_success);
Actual: 0 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.DISABLED_TEST", line 27 ut.expect(l_suite.results_count.disabled_count).to_equal(1);
Actual: 0 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.DISABLED_TEST", line 29 ut.expect(l_suite.results_count.success_count).to_equal(1);
Actual: 2 (number) was expected to equal: 0 (number)
at "UT3_TESTER.TEST_UT_TEST.DISABLED_TEST", line 31 ut.expect(l_suite.results_count.errored_count).to_equal(0);
6) aftertest_errors
Actual: NULL (number) was expected to equal: 3 (number)
at "UT3_TESTER.TEST_UT_TEST.AFTERTEST_ERRORS", line 53 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(3);
Actual: 0 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.AFTERTEST_ERRORS", line 57 ut.expect(l_suite.results_count.success_count).to_equal(1);
Actual: 2 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.AFTERTEST_ERRORS", line 59 ut.expect(l_suite.results_count.errored_count).to_equal(1);
7) aftereach_errors
Actual: NULL (number) was expected to equal: 3 (number)
at "UT3_TESTER.TEST_UT_TEST.AFTEREACH_ERRORS", line 79 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(3);
Actual: 0 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.AFTEREACH_ERRORS", line 83 ut.expect(l_suite.results_count.success_count).to_equal(1);
Actual: 2 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.AFTEREACH_ERRORS", line 85 ut.expect(l_suite.results_count.errored_count).to_equal(1);
8) beforetest_errors
Actual: NULL (number) was expected to equal: 2 (number)
at "UT3_TESTER.TEST_UT_TEST.BEFORETEST_ERRORS", line 105 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(2);
Actual: 0 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.BEFORETEST_ERRORS", line 109 ut.expect(l_suite.results_count.success_count).to_equal(1);
Actual: 2 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.BEFORETEST_ERRORS", line 111 ut.expect(l_suite.results_count.errored_count).to_equal(1);
9) beforeeach_errors
Actual: NULL (number) was expected to equal: 2 (number)
at "UT3_TESTER.TEST_UT_TEST.BEFOREEACH_ERRORS", line 131 ut.expect(ut3_tester_helper.ut_example_tests.g_number).to_equal(2);
Actual: 0 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.BEFOREEACH_ERRORS", line 135 ut.expect(l_suite.results_count.success_count).to_equal(1);
Actual: 2 (number) was expected to equal: 1 (number)
at "UT3_TESTER.TEST_UT_TEST.BEFOREEACH_ERRORS", line 137 ut.expect(l_suite.results_count.errored_count).to_equal(1);
10) rollback_manual
Actual: 0 (number) was expected to be greater than: 0 (number)
at "UT3_TESTER_HELPER.RUN_HELPER.TEST_ROLLBACK_TYPE", line 556 ut.expect(main_helper.get_value(q'[ut_transaction_control.count_rows('t')]')).to_( a_expectation );
Actual: 0 (number) was expected to be greater than: 0 (number)
at "UT3_TESTER_HELPER.RUN_HELPER.TEST_ROLLBACK_TYPE", line 557 ut.expect(main_helper.get_value(q'[ut_transaction_control.count_rows('s')]')).to_( a_expectation );
11) rollback_manual_on_failure
Actual: 0 (number) was expected to be greater than: 0 (number)
at "UT3_TESTER_HELPER.RUN_HELPER.TEST_ROLLBACK_TYPE", line 556 ut.expect(main_helper.get_value(q'[ut_transaction_control.count_rows('t')]')).to_( a_expectation );
Actual: 0 (number) was expected to be greater than: 0 (number)
at "UT3_TESTER_HELPER.RUN_HELPER.TEST_ROLLBACK_TYPE", line 557 ut.expect(main_helper.get_value(q'[ut_transaction_control.count_rows('s')]')).to_( a_expectation );
Finished in 12.283786 seconds
233 tests, 11 failed, 0 errored, 1 disabled, 0 warning(s)
-
connect as user
ut3_tester_helper -
run the following (same as in step 3):
SET SERVEROUTPUT ON SIZE UNLIMITED
EXECUTE ut.run('UT3_TESTER');
- look at the ouput (no errors, excerpt):
Finished in 13.088981 seconds
233 tests, 0 failed, 0 errored, 1 disabled, 0 warning(s)
Expected behavior
- Option 1: step 3 and 5 produced the same number of succeeded, failed, errored tests
- Option 2: if option 1 is not feasible, this should be documented and reported in an sensible way, so that the user knows what to do (and maybe also why).