Fu Hanxi
97132c40fd
ttfw: mock missing packages while search cases
2022-07-14 08:26:01 +08:00
Fu Hanxi
c9b73a554e
ttfw: record test script path in case_info
2022-07-14 08:26:01 +08:00
Fu Hanxi
f7a0e0cb5c
ci: raise ImportError when search case failed instead of print the error
2022-07-14 08:26:01 +08:00
simon.chupin
09d15e5abc
tools: Change copyright in ci dir
2022-07-11 12:58:06 +00:00
Fu Hanxi
4a59bf9594
Revert "ci: temporarily disable s3 assign test"
...
This reverts commit 8a31c52825
.
2022-03-25 12:39:57 +08:00
Fu Hanxi
8a31c52825
ci: temporarily disable s3 assign test
2022-03-21 14:50:33 +08:00
Fu Hanxi
851d832eb6
ci: enable test_apps s3 c3 tests
...
Refactor the tags a bit to make the tags could reuse the env markers.
They suppose to be the same thing.
2022-03-10 11:56:15 +08:00
Fu Hanxi
1f14dc5b74
ci: abort with all ImportErrors when detecting ImportError while search tests cases
2021-11-25 18:56:19 +08:00
He Yin Ling
2849f3bf44
Merge branch 'test/add_ethernet_iperf_example_test_case' into 'master'
...
Test: add ethernet iperf example test case
Closes TCI-463
See merge request espressif/esp-idf!13696
2021-07-28 01:39:12 +00:00
Lu Ai Jun
d29335710d
test: add ethernet iperf example test case
2021-07-28 09:39:02 +08:00
He Yin Ling
35f8caf1cb
Merge branch 'bugfix/ttfw_fix_flush_index_error' into 'master'
...
test: TTFW fix flush index error
See merge request espressif/esp-idf!14217
2021-07-22 12:55:27 +00:00
He Yin Ling
1708febe48
ttfw: fix incorrect length when flush data cache after expect:
...
data cache is unicode. while we use bytes in RegEx expect. The index of
matched pattern is calculated with bytes, could be different from
unicode. Now we fix this issue by using unicode in expect.
2021-07-13 13:07:08 +08:00
He Yin Ling
b79778d273
ttfw: full_stdout should not return data after pattern in expect
2021-07-13 13:07:08 +08:00
Angus Gratton
bfb602d0fc
ci: Fix error message if insufficient jobs for test case tag
2021-07-05 12:08:36 +08:00
He Yin Ling
31773b8ed2
ttfw: fix DUT check functions are called after case finished:
...
DUT check functions are executed in receive thread. If we put data to
data cache before execute the check functions, the main thread could
handle the data cache first and mark test case finished. We will execute
check functions first to make sure it's executed before case finished.
2021-06-18 09:58:19 +08:00
He Yin Ling
201018da43
Merge branch 'ci/shorter_performance_test_log' into 'master'
...
ci: optimize performance test log
See merge request espressif/esp-idf!13607
2021-05-21 06:48:16 +00:00
He Yin Ling
8434c0c731
ttfw: fix DUT exception not added to junit report
2021-05-20 16:28:20 +08:00
Fu Hanxi
bccaab7e6c
fix(ci): fix missing [Performance] prefix in junit report
2021-05-20 14:13:54 +08:00
Fu Hanxi
9b8d1e7826
fix(ci): return as failed when no test case result generated
2021-04-20 11:18:12 +08:00
Fu Hanxi
92a9ad0b31
ci: allow wildcard in known failure cases
2021-04-01 19:29:04 +08:00
Fu Hanxi
4ffd458ddd
ci: bugfix: known failure cases cannot read files
2021-02-09 15:33:49 +08:00
Fu Hanxi
85d4bca81a
feat(tiny_test_fw): unify all junit report test case name
...
new format: <target>.<config>.<case_name>, the default value of
"config" is "default"
2021-01-28 12:25:14 +08:00
Fu Hanxi
d63069068f
feat(tiny_test_fw): ignore known failure cases result
...
py
2021-01-28 12:25:14 +08:00
Fu Hanxi
0146f258d7
style: format python files with isort and double-quote-string-fixer
2021-01-26 10:49:01 +08:00
He Yin Ling
5befaac4be
ttfw: fix get dut failed when dut port is set as env variable
2021-01-14 17:22:11 +08:00
Angus Gratton
6d3e06a9a3
ttfw: Move TestCaseFailed exception and handle differently to other exceptions
...
But also ensure the string form of this exception is never empty, if it ends up
somewhere else.
2021-01-12 11:42:03 +11:00
Angus Gratton
441d1306be
ci ttfw: Consistently handle unexpected exceptions in test cases
2021-01-12 11:42:03 +11:00
He Yin Ling
4e82540730
ttfw: save console log to file
2021-01-07 17:10:40 +08:00
Fu Hanxi
3a88626ec3
search case: print target as well
2020-12-15 17:56:53 +08:00
Angus Gratton
26fb74bc97
ci: ttfw: Encode serial port data to whatever the console encoding is
...
This is a bit of a hack, but gives us a way to always log it
2020-11-24 18:32:47 +11:00
Angus Gratton
37838803db
ci: Log failure to close any DUT
2020-11-24 18:32:47 +11:00
Angus Gratton
66fb5a29bb
Whitespace: Automated whitespace fixes (large commit)
...
Apply the pre-commit hook whitespace fixes to all files in the repo.
(Line endings, blank lines at end of file, trailing whitespace)
2020-11-11 07:36:35 +00:00
Ivan Grokhotkov
f16d231197
Merge branch 'feature/improve_load_env_log' into 'master'
...
CI: Improve load env config log output
See merge request espressif/esp-idf!9587
2020-09-16 01:59:05 +08:00
Fu Hanxi
edc7cc9c00
add component_ut in assign-test and target-test stage.
...
Add one template_test python file to get test case
2020-09-07 12:12:11 +08:00
Fu Hanxi
ef2813a068
CI: Improve load env config log output
2020-08-05 07:49:02 +00:00
Fu Hanxi
53aacef29c
code clean up
2020-07-06 19:05:44 +08:00
Fu Hanxi
b26d42afe3
Now scan_tests will generate 'scan_<target>.json`
...
also updated CI yaml and shell scripts
2020-07-06 19:05:44 +08:00
Fu Hanxi
b76df30915
don't overwrite special cases dut
2020-06-01 13:39:09 +08:00
Fu Hanxi
377d3eaaa5
Move local target detection to ttfw_idf
...
rename upper_list to upper_list_or_str
minor fix for `unit_test.py` `is 'name'` -> `== 'name`
2020-06-01 12:08:57 +08:00
Fu Hanxi
5c92d36078
Add list support for ttfw_idf test decorators. Only replicate supported keys
2020-05-29 12:42:56 +08:00
Fu Hanxi
e553092d62
move ci_target_check to ttfw_idf, move ci_target_filter to AssignTest
...
mark `supported_in_ci` for AssignTest filter.
2020-05-29 12:42:56 +08:00
Fu Hanxi
38c288bc0e
Add BOT_TARGET_FILTER
to _apply_bot_filter
...
fix the bug that will calculate twice if ci_target is a list.
2020-05-29 12:42:56 +08:00
Fu Hanxi
bc026133c5
add ci_target filter for target and local target check
2020-05-29 12:42:56 +08:00
Fu Hanxi
9f8b63da38
Pass current target to test_method **overwrite.
2020-05-29 12:42:56 +08:00
Fu Hanxi
6c98d7e4bd
Add multi target support for search examples
...
drop keyword `dut`, use `target` instead to assign`dut_class` to `Env`
2020-05-29 12:42:56 +08:00
Ivan Grokhotkov
3fe4adc98d
ttfw: allow relative imports in test scripts
2020-05-12 22:27:06 +02:00
Ivan Grokhotkov
26f6136a7d
ttfw: only send relevant DUT kwargs to serial.serial_for_url
2020-05-12 22:27:06 +02:00
Fu Hanxi
04342a73f2
Fix some python bugs left before
2020-04-30 06:47:49 +00:00
Fu Hanxi
76d118577e
test_config: fix the bug that will generate !!python/unicode
...
As an example, [7964999 example_test_002_](https://gitlab.espressif.cn:6688/espressif/esp-idf/-/jobs/7964999/artifacts/file/examples/test_configs/example_test_002_.yml )
2020-04-08 11:19:13 +08:00
David Cermak
a463e80d43
ci: fix ttfw ignoring test failure if exception in print_debug_info
2020-04-05 20:07:27 +02:00