He Yin Ling
b8ca42400b
ttfw: fix incorrect length when flush data cache after expect:
...
data cache is unicode. while we use bytes in RegEx expect. The index of
matched pattern is calculated with bytes, could be different from
unicode. Now we fix this issue by using unicode in expect.
2021-07-05 19:43:15 +08:00
He Yin Ling
ce279af00d
ttfw: full_stdout should not return data after pattern in expect
2021-07-05 19:43:14 +08:00
KonstantinKondrashov
2d439ba001
simple_ota_example: Adds sha256 check for app images
2021-06-22 08:30:43 +08:00
He Yin Ling
cb8d4585b2
Merge branch 'test/support_multiple_targets_for_iperf_example_test_v4.3' into 'release/v4.3'
...
test: support multiple targets for iperf example test (v4.3)
See merge request espressif/esp-idf!13617
2021-06-17 03:48:12 +00:00
He Yin Ling
850d8170f5
Merge branch 'ci/ttfw_fix_dut_exception_not_added_to_junit_report_v4.3' into 'release/v4.3'
...
ttfw: fix DUT exception not added to junit report (v4.3)
See merge request espressif/esp-idf!13611
2021-06-17 03:36:02 +00:00
He Yin Ling
528d162da5
ttfw: fix DUT exception not added to junit report
2021-06-16 09:50:09 +08:00
He Yin Ling
6fe2da9f89
ci: save built binaries could be tested locally:
...
we have some test cases not executed in CI. we need to save those
binaries as artifacts so we can test locally.
2021-06-16 09:49:23 +08:00
Shivani Tipnis
1c875e5baa
ble-wifi-example-tests: Add fixes and cleanups to ble and wifi tests
...
(cherry picked from commit 2d22374460
)
2021-06-01 12:27:04 +05:30
Fu Hanxi
229fab87a5
ci: allow wildcard in known failure cases
2021-05-07 08:41:43 +00:00
Fu Hanxi
7d7ad29d5a
fix(ci): return as failed when no test case result generated
2021-04-20 17:16:02 +08:00
Fu Hanxi
662b6bb48a
fix(ci): ci_fetch_submodule return full match name first
2021-04-19 20:19:43 +08:00
Fu Hanxi
4ffd458ddd
ci: bugfix: known failure cases cannot read files
2021-02-09 15:33:49 +08:00
Ivan Grokhotkov
9a20283485
Merge branch 'bugfix/scan_test_missing_build_apps_without_tests' into 'master'
...
ci: bugfix: scan_test missing build apps without tests
See merge request espressif/esp-idf!12138
2021-01-28 17:48:24 +08:00
Fu Hanxi
85d4bca81a
feat(tiny_test_fw): unify all junit report test case name
...
new format: <target>.<config>.<case_name>, the default value of
"config" is "default"
2021-01-28 12:25:14 +08:00
Fu Hanxi
d63069068f
feat(tiny_test_fw): ignore known failure cases result
...
py
2021-01-28 12:25:14 +08:00
Fu Hanxi
be3d74efb2
fix(ci): scan_test missing build apps without tests
2021-01-27 12:35:49 +08:00
Fu Hanxi
0146f258d7
style: format python files with isort and double-quote-string-fixer
2021-01-26 10:49:01 +08:00
Aditya Patwardhan
b77c85c1e1
ttfw/IDFDUT: i) Added option to erase_flash in the IDFDUT class
...
ii) Renamed the method dump_flush to dump_flash
2021-01-20 11:12:14 +00:00
He Yin Ling
5befaac4be
ttfw: fix get dut failed when dut port is set as env variable
2021-01-14 17:22:11 +08:00
Angus Gratton
6d3e06a9a3
ttfw: Move TestCaseFailed exception and handle differently to other exceptions
...
But also ensure the string form of this exception is never empty, if it ends up
somewhere else.
2021-01-12 11:42:03 +11:00
Angus Gratton
441d1306be
ci ttfw: Consistently handle unexpected exceptions in test cases
2021-01-12 11:42:03 +11:00
He Yin Ling
97220af848
test: use pyecharts to replace matplotlib in iperf test
2021-01-07 17:10:41 +08:00
He Yin Ling
4e82540730
ttfw: save console log to file
2021-01-07 17:10:40 +08:00
He Yin Ling
16a488c405
test: fix iperf example errors:
...
1. fix TypeError when running with python3
2. fix throughput chart x/y axis label error
3. make test case compatibile with iperf bin on earlier release branches
2021-01-07 17:10:40 +08:00
Angus Gratton
ec75f923ef
Merge branch 'ci/raise_esptool_errors' into 'master'
...
ci: Don't swallow exception details from flashing process
See merge request espressif/esp-idf!11803
2020-12-30 11:22:57 +08:00
Marius Vikhammer
7fe16bae25
tools: merge C3 changes into master
2020-12-30 07:04:12 +08:00
Angus Gratton
88d0d1fa02
ci: Don't swallow exception details from flashing process
...
If flashing fails, throw an exception that includes some information about the failure.
2020-12-29 15:41:22 +11:00
Omar Chebib
fcbc706a66
ci: fix flasher_args.json parser (iterate over dictionary)
...
Closes IDFCI-347
2020-12-29 12:27:51 +08:00
Ivan Grokhotkov
0b31f6a5fc
Merge branch 'feature/ci_flasher_args_json_encrypted_flag' into 'master'
...
ci: use "encrypted" information in flasher_args.json
Closes IDF-2231
See merge request espressif/esp-idf!11551
2020-12-28 06:37:05 +08:00
Omar Chebib
05f97542b8
ci: use "encrypted" information in flasher_args.json
...
Take into account the new field "encrypted" that is part of the
partition entries in flasher_args.json file
Closes IDF-2231
2020-12-23 18:16:17 +08:00
Fu Hanxi
eda42035d2
scan test: bugfix: now can build multi target for one app
2020-12-15 17:56:53 +08:00
Fu Hanxi
3a88626ec3
search case: print target as well
2020-12-15 17:56:53 +08:00
Fu Hanxi
a5bcaea9cc
use "additional_duts" to overwrite dut class for different targets
2020-12-15 17:55:54 +08:00
Fu Hanxi
7281a5a0cc
Split component_ut tests based on targets
...
- add more label in CIScanTest.py
- fix the bug that will cause labels not iterate correctly
2020-11-30 14:08:54 +08:00
Angus Gratton
190aed41ee
Merge branch 'bugfix/ttfw_example_test_fails_port_remains_open' into 'master'
...
ci: Fix CI issue if one example test fails, and if serial port returns some noise
Closes IDFCI-236
See merge request espressif/esp-idf!11273
2020-11-26 08:04:00 +08:00
Angus Gratton
26fb74bc97
ci: ttfw: Encode serial port data to whatever the console encoding is
...
This is a bit of a hack, but gives us a way to always log it
2020-11-24 18:32:47 +11:00
Angus Gratton
37838803db
ci: Log failure to close any DUT
2020-11-24 18:32:47 +11:00
He Yin Ling
e568daf213
ttfw: fix idf performance check doesn't work
2020-11-12 09:49:44 +00:00
Mahavir Jain
0fb65d0bae
Merge branch 'bugfix/ttfw_idf_find_artifacts_inaccurate_with_same_prefix_path' into 'master'
...
CI: fix the bug returns wrong artifact path when app_name is a subset of a longer one
Closes IDFCI-217
See merge request espressif/esp-idf!11187
2020-11-12 12:12:51 +08:00
Angus Gratton
66fb5a29bb
Whitespace: Automated whitespace fixes (large commit)
...
Apply the pre-commit hook whitespace fixes to all files in the repo.
(Line endings, blank lines at end of file, trailing whitespace)
2020-11-11 07:36:35 +00:00
Fu Hanxi
5fa935e5ea
CI: fix the bug returns wrong artifact path when app_name is a subset of a longer one
2020-11-11 12:31:39 +08:00
Fu Hanxi
75ab9223f9
scan test when weekend test.
2020-10-26 10:25:21 +08:00
Ivan Grokhotkov
2218ac91c2
tools/ci: fix import error when running ttfw tests locally
2020-10-13 18:09:22 +02:00
morris
9fa06719fa
global: enable build uinit test for esp32-s3
2020-09-22 15:15:03 +08:00
Ivan Grokhotkov
d17a3c76d0
ci: fetch submodules from mirror, if enabled
2020-09-16 21:22:26 +02:00
Ivan Grokhotkov
f16d231197
Merge branch 'feature/improve_load_env_log' into 'master'
...
CI: Improve load env config log output
See merge request espressif/esp-idf!9587
2020-09-16 01:59:05 +08:00
Fu Hanxi
edc7cc9c00
add component_ut in assign-test and target-test stage.
...
Add one template_test python file to get test case
2020-09-07 12:12:11 +08:00
Fu Hanxi
e35328afd9
build component unit test apps
...
use idf_py_actions supported targets
2020-09-07 12:11:55 +08:00
Fu Hanxi
ef2813a068
CI: Improve load env config log output
2020-08-05 07:49:02 +00:00
Fu Hanxi
0478edc6ba
CI: download only required bin for unit-tests. Refactor AssignTest related code
2020-08-04 13:27:16 +08:00