Re: Using sanitycheck to run my project tests


Nashif, Anas
 

You should get rid of the build_only

 

From: users@... [mailto:users@...] On Behalf Of Rodrigo Peixoto
Sent: Thursday, July 19, 2018 10:06 AM
To: Nashif, Anas <anas.nashif@...>
Cc: users@...
Subject: Re: [Zephyr-users] Using sanitycheck to run my project tests

 

Maybe it is not an issue, but a miss use of my part. Should I open the issue?

 

My testcase.yaml is:

    

    tests:

      build:

        build_only: true

 

The error I am forcing is a zassert to be false in one of the tests that must run. When I run this manually, the error appears.  


Rodrigo Peixoto

Co-founder and Technical advisor

 

+55 (82) 98144-8585

http://ayna.tech | Skype: rodrigopex

 

 

2018-07-19 10:59 GMT-03:00 Nashif, Anas <anas.nashif@...>:

What kind of error did you force? What do you have in testcase.yaml? Can you run with -vv? Please open an issue on GH and attach output there.

 

Anas

 

From: <users@...> on behalf of Rodrigo Peixoto <rodrigopex@...>
Date: Thursday, 19 July 2018 at 09:53
To: Anas Nashif <anas.nashif@...>
Cc: "users@..." <users@...>
Subject: Re: [Zephyr-users] Using sanitycheck to run my project tests

 

But when I force an error it doesn't affect the result.

 

Any clue?


Rodrigo Peixoto

Co-founder and Technical advisor

 

+55 (82) 98144-8585

http://ayna.tech | Skype: rodrigopex

 

 

2018-07-19 10:46 GMT-03:00 Nashif, Anas <anas.nashif@...>:

--list-tests give you the list of sub-tests in a test project, sanitycheck results report on the test project level, not the sub-tests.

 

Anas

 

From: users@... [mailto:users@...] On Behalf Of Rodrigo Peixoto
Sent: Thursday, July 19, 2018 9:22 AM
To: users@...
Subject: [Zephyr-users] Using sanitycheck to run my project tests

 

Hi all.

 

I was creating my unit, integration, and regression test for a project I am involved, I was wondering if it is possible to use the sanitycheck script to run my own tests that are not related to zephyr kernel. 

 

Folder hierarchy:

 

my_project_folder/

        include/

        src/

        CMakeLists.txt

        ...

        tests/

                test_at/

                        testcase.yaml

                        src/

                        ...

 

 

I have run in my own tests folder: 

 

   $ sanitycheck -p native_posix -T . --list-tests

       - build.action_data

       - build.action_data_offset

       - build.action_enqueue

       - build.action_send_sync_thread

       - build.base_action

       - build.send_at_vsx_off

       - build.send_at_vsx_on

       - build.send_at_vsx_on_status_off

      8 total.

 

It shows 8 tests in total. When I run:

 

   $ sanitycheck -p native_posix -T . --outdir ./santy-out

      Building testcase defconfigs...

      1 tests selected, 107 tests discarded due to filters

      total complete:    1/   1  100%  failed:    0

      1 of 1 tests passed with 0 warnings in 2 seconds

 

It shows 1 test had run ok, but I already changed the test to make it fails but the result is always the same. Another weird thing is the number of tests of 107 discard and 1 selected... 

 

How can I run that properly? I would like to do that without copying the tests to the kernel folder. Is it possible?

 

 

Thank you.

Best regards,

Rodrigo Peixoto

Co-founder and Technical advisor

 

+55 (82) 98144-8585

http://ayna.tech | Skype: rodrigopex

 

 

 

Join {users@lists.zephyrproject.org to automatically receive all group messages.