Analysis of yaml test scenarios opitons


Gołyźniak, Piotr
 

Hi,

At the request of Hake Huang, I’m sharing csv document which contains listed all test scenarios taken from sample.yaml and testcase.yaml files in Zephyr project. In next columns each test scenario has list of possible options (like tags, extra_args, platform_allow, etc.). After opening this file in Excel there can be applied filter in first row, which can be useful to filtering desirable options. This file can be helpful during static analysis of test defined in yaml files and as Hake mentioned, it can be used to schedule group of tests which can be run on most of platforms.

This csv document was generated today basing on Zephyr’s main branch with commit SHA: 8563744997a057780a30b5566de8acfe699b3f9d

 

If you are interested in generating such csv document by your own, you can do it by using my python script, which are temporarily accessible here on my Zephyr fork repo:
https://github.com/gopiotr/zephyr/blob/dev/yaml_file_analyzer/scripts/pylib/twister/yaml_options_analyzer.py

To do this you have to download this script, export ZEPHYR_BASE environment and run script in CLI by “python yaml_options_analyzer.py” command.

 

I know that this csv report is not the “cleanest” report and at first glance it can be overwhelming and confusing. So, during next meeting I can quickly present how to handle it and how to get desirable information from it.

 

Piotr Gołyźniak | Software Test Developer
M +48 507 565 390 | Kraków, Poland
nordicsemi.com | devzone.nordicsemi.com

Nordic_logo_signature

 


Hake Huang
 

Grate thanks to Piotr.

 

Regards,

Hake

 

From: Gołyźniak, Piotr <piotr.golyzniak@...>
Sent: 2022
93 1:26
To: testing-wg@...
Cc: Hake Huang <hake.huang@...>
Subject: [EXT] Analysis of yaml test scenarios opitons

 

Caution: EXT Email

Hi,

At the request of Hake Huang, I’m sharing csv document which contains listed all test scenarios taken from sample.yaml and testcase.yaml files in Zephyr project. In next columns each test scenario has list of possible options (like tags, extra_args, platform_allow, etc.). After opening this file in Excel there can be applied filter in first row, which can be useful to filtering desirable options. This file can be helpful during static analysis of test defined in yaml files and as Hake mentioned, it can be used to schedule group of tests which can be run on most of platforms.

This csv document was generated today basing on Zephyr’s main branch with commit SHA: 8563744997a057780a30b5566de8acfe699b3f9d

 

If you are interested in generating such csv document by your own, you can do it by using my python script, which are temporarily accessible here on my Zephyr fork repo:
https://github.com/gopiotr/zephyr/blob/dev/yaml_file_analyzer/scripts/pylib/twister/yaml_options_analyzer.py

To do this you have to download this script, export ZEPHYR_BASE environment and run script in CLI by “python yaml_options_analyzer.py” command.

 

I know that this csv report is not the “cleanest” report and at first glance it can be overwhelming and confusing. So, during next meeting I can quickly present how to handle it and how to get desirable information from it.

 

Piotr Gołyźniak | Software Test Developer
M +48 507 565 390 | Kraków, Poland
nordicsemi.com | devzone.nordicsemi.com

Nordic_logo_signature

 


Hake Huang
 

Hi Piotr, et. al.

 

I add filters to each column for minimal test set selection please check, we can discuss this list in tomorrow meeting.

 

Regards,

Hake

 

From: Gołyźniak, Piotr <piotr.golyzniak@...>
Sent: 2022
93 1:26
To: testing-wg@...
Cc: Hake Huang <hake.huang@...>
Subject: [EXT] Analysis of yaml test scenarios opitons

 

Caution: EXT Email

Hi,

At the request of Hake Huang, I’m sharing csv document which contains listed all test scenarios taken from sample.yaml and testcase.yaml files in Zephyr project. In next columns each test scenario has list of possible options (like tags, extra_args, platform_allow, etc.). After opening this file in Excel there can be applied filter in first row, which can be useful to filtering desirable options. This file can be helpful during static analysis of test defined in yaml files and as Hake mentioned, it can be used to schedule group of tests which can be run on most of platforms.

This csv document was generated today basing on Zephyr’s main branch with commit SHA: 8563744997a057780a30b5566de8acfe699b3f9d

 

If you are interested in generating such csv document by your own, you can do it by using my python script, which are temporarily accessible here on my Zephyr fork repo:
https://github.com/gopiotr/zephyr/blob/dev/yaml_file_analyzer/scripts/pylib/twister/yaml_options_analyzer.py

To do this you have to download this script, export ZEPHYR_BASE environment and run script in CLI by “python yaml_options_analyzer.py” command.

 

I know that this csv report is not the “cleanest” report and at first glance it can be overwhelming and confusing. So, during next meeting I can quickly present how to handle it and how to get desirable information from it.

 

Piotr Gołyźniak | Software Test Developer
M +48 507 565 390 | Kraków, Poland
nordicsemi.com | devzone.nordicsemi.com

Nordic_logo_signature